-- Logs begin at Mon 2021-11-22 11:40:04 UTC, end at Mon 2021-11-22 12:39:24 UTC. -- Nov 22 12:10:56.530716 dv-cinder-768458-13-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Nov 22 12:10:56.540383 dv-cinder-768458-13-iscsi devstack@n-api.service[102056]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Nov 22 12:10:56.542570 dv-cinder-768458-13-iscsi devstack@n-api.service[102056]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Nov 22 12:10:56 2021] *** Nov 22 12:10:56.542570 dv-cinder-768458-13-iscsi devstack@n-api.service[102056]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Nov 22 12:10:56.542570 dv-cinder-768458-13-iscsi devstack@n-api.service[102056]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Nov 22 12:10:56.542570 dv-cinder-768458-13-iscsi devstack@n-api.service[102056]: nodename: dv-cinder-768458-13-iscsi Nov 22 12:10:56.542570 dv-cinder-768458-13-iscsi devstack@n-api.service[102056]: machine: x86_64 Nov 22 12:10:56.542570 dv-cinder-768458-13-iscsi devstack@n-api.service[102056]: clock source: unix Nov 22 12:10:56.542570 dv-cinder-768458-13-iscsi devstack@n-api.service[102056]: pcre jit disabled Nov 22 12:10:56.542570 dv-cinder-768458-13-iscsi devstack@n-api.service[102056]: detected number of CPU cores: 4 Nov 22 12:10:56.542570 dv-cinder-768458-13-iscsi devstack@n-api.service[102056]: current working directory: / Nov 22 12:10:56.542570 dv-cinder-768458-13-iscsi devstack@n-api.service[102056]: detected binary path: /usr/bin/uwsgi-core Nov 22 12:10:56.542570 dv-cinder-768458-13-iscsi devstack@n-api.service[102056]: your processes number limit is 47680 Nov 22 12:10:56.542570 dv-cinder-768458-13-iscsi devstack@n-api.service[102056]: your memory page size is 4096 bytes Nov 22 12:10:56.542570 dv-cinder-768458-13-iscsi devstack@n-api.service[102056]: detected max file descriptor number: 2048 Nov 22 12:10:56.542570 dv-cinder-768458-13-iscsi devstack@n-api.service[102056]: lock engine: pthread robust mutexes Nov 22 12:10:56.543597 dv-cinder-768458-13-iscsi devstack@n-api.service[102056]: thunder lock: enabled Nov 22 12:10:56.543597 dv-cinder-768458-13-iscsi devstack@n-api.service[102056]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Nov 22 12:10:56.543597 dv-cinder-768458-13-iscsi devstack@n-api.service[102056]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Nov 22 12:10:56.585910 dv-cinder-768458-13-iscsi devstack@n-api.service[102056]: Python main interpreter initialized at 0x5632f40f29c0 Nov 22 12:10:56.585910 dv-cinder-768458-13-iscsi devstack@n-api.service[102056]: python threads support enabled Nov 22 12:10:56.585910 dv-cinder-768458-13-iscsi devstack@n-api.service[102056]: your server socket listen backlog is limited to 100 connections Nov 22 12:10:56.585910 dv-cinder-768458-13-iscsi devstack@n-api.service[102056]: your mercy for graceful operations on workers is 90 seconds Nov 22 12:10:56.586312 dv-cinder-768458-13-iscsi devstack@n-api.service[102056]: mapped 403077 bytes (393 KB) for 2 cores Nov 22 12:10:56.586312 dv-cinder-768458-13-iscsi devstack@n-api.service[102056]: *** Operational MODE: preforking *** Nov 22 12:10:56.586596 dv-cinder-768458-13-iscsi devstack@n-api.service[102056]: *** uWSGI is running in multiple interpreter mode *** Nov 22 12:10:56.586596 dv-cinder-768458-13-iscsi devstack@n-api.service[102056]: spawned uWSGI master process (pid: 102056) Nov 22 12:10:56.586823 dv-cinder-768458-13-iscsi systemd[1]: Started Devstack devstack@n-api.service. Nov 22 12:10:56.587881 dv-cinder-768458-13-iscsi devstack@n-api.service[102056]: spawned uWSGI worker 1 (pid: 102057, cores: 1) Nov 22 12:10:56.587881 dv-cinder-768458-13-iscsi devstack@n-api.service[102056]: spawned uWSGI worker 2 (pid: 102058, cores: 1) Nov 22 12:10:56.587881 dv-cinder-768458-13-iscsi devstack@n-api.service[102056]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Nov 22 12:10:58.191192 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 22 12:10:58.191192 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: from cryptography.utils import int_from_bytes Nov 22 12:10:58.191932 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 22 12:10:58.191932 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: from cryptography.utils import int_from_bytes Nov 22 12:10:58.192048 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 22 12:10:58.192048 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: from cryptography.utils import int_from_bytes Nov 22 12:10:58.192631 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 22 12:10:58.192631 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: from cryptography.utils import int_from_bytes Nov 22 12:11:00.669154 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 22 12:11:00.669822 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 22 12:11:00.669916 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 22 12:11:00.669916 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 22 12:11:00.670307 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 22 12:11:00.670307 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 22 12:11:00.670435 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 22 12:11:00.670506 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 22 12:11:00.670669 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 22 12:11:00.670888 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.670993 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 22 12:11:00.671247 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.671357 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.671578 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.671696 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.671930 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.672059 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.672244 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.672339 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.672537 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.672647 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.672870 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.673010 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.673190 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.673286 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.673504 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.673611 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.673756 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.673866 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.674078 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.674192 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.674389 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.674492 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-768458-13-iscsi {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.674713 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.674805 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-768458-13-iscsi {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.675021 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.675128 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.676720 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.676849 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.677033 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.677161 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.677161 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.677605 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.677605 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.677944 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.677944 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.678151 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.678151 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.678472 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.678472 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.678696 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.678823 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.678936 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.679051 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.679160 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.679299 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.679450 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.679571 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.679665 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.679740 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.679825 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.679946 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.680026 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.680026 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.680232 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.680356 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.680701 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.680850 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.681070 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.681501 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-768458-13-iscsi {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.681820 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.682138 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.682313 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.682454 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.682868 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.683174 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.683518 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.683852 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.684124 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-768458-13-iscsi {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.684291 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.684465 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.684654 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.684769 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.684841 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.685122 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.685369 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.685547 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.685924 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.686480 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.686804 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.687060 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.687219 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.687434 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.687598 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.687789 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.687883 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.688101 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.688206 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.688397 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.688517 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.688669 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.688757 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.688983 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.689081 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.689304 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.689450 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.689633 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.689732 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.689959 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.690076 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.690232 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.690374 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.690523 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.690673 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.690818 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.690918 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.691124 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.691339 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.691455 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.691540 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.691679 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.691778 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.691984 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.692076 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.692293 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.692403 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.692681 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.692943 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.693100 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.693329 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.693494 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.693638 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.693874 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.693973 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.694234 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.694434 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.694569 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.694677 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.694888 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.695000 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.695183 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.695321 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.695545 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.695686 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.66 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.695853 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.66 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.695938 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.696327 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.696553 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.696642 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.696909 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.697005 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.697232 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.697350 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.697542 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.697668 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.697867 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.697994 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.698191 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.698319 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.698504 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.698651 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.698818 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.698967 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.699128 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.699316 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.699477 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.699726 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.66 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.699829 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.699983 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.66 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.700107 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.700299 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.700384 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.700646 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.700744 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.700953 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.701047 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.701265 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.701348 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.701569 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.701653 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.701878 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.701969 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.702867 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.702975 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.703066 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.703146 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.703222 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.703368 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.703453 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.703530 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.703669 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.703754 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.703830 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.703907 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.703983 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.704059 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.704267 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.704353 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.704596 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.704774 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.704864 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.704937 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.705163 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.705254 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.705481 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.705573 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.705794 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.705903 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.706094 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.706186 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.706401 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.706533 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.706707 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.706879 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.707016 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.707103 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.707354 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.707443 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.707666 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.707761 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.707974 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.708065 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.708318 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.708453 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.708630 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.708798 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.708950 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.709037 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.709239 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.709352 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.709564 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.709664 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.709877 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.709969 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.710189 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.710277 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.710502 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.710595 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.710813 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.710905 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.711136 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.711221 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.711470 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.711567 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.711777 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.711862 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.712082 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.712167 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.712386 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.712479 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.712691 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.712781 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.712996 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.713078 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.713301 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.713387 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.713608 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.713694 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.713909 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.713994 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.714219 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.714302 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.714530 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.714621 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.714838 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.714931 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.715146 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.715262 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.715478 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.715563 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.715785 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.715869 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.716092 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.716178 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.716428 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.716518 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.716721 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.716814 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.717002 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.717087 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.717308 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.717398 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.717611 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.717704 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.717934 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.718018 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.718259 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.718350 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.718573 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.718668 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.718888 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.718980 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.719202 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.719346 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.719535 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.719621 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:11:00.719847 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.719931 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.720164 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.720294 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.720482 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.720568 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.720807 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.720891 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.721123 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.721206 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.721436 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.721533 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.721756 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.721841 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.722067 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.722149 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.722380 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.722471 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.722704 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.722810 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.723015 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.723101 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.723347 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.723441 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.723657 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.723752 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.724054 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.724243 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.724380 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.724599 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.724726 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.724924 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.725013 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.725240 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.725326 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.725563 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.725654 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.725880 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.725973 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.726198 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.726283 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.726512 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.726597 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.726841 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.726925 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.727151 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.727249 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.727488 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.727573 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.727831 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.727923 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.728146 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.728232 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.728461 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.728544 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.728766 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.728860 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.729072 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.729157 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.729378 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.729461 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.729686 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.729783 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.730038 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.730133 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.730311 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.730395 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.730623 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.730798 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.730932 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.731067 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.731297 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.731416 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.731616 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.731728 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.731932 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.732020 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.732240 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.732328 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.732541 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.732637 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.732842 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.732935 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.733151 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.733238 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.733456 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.733553 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.733779 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.733880 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.734087 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.734188 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.734390 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.734479 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.734712 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.734801 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.735018 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.735111 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.735346 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.735446 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.735656 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.735757 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.735961 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.736058 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.736272 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.736389 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.736581 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.736668 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.736885 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.736986 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.737197 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.737292 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.737509 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.737612 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.737868 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.737978 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.738146 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.738243 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.738447 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.738553 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.738751 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.738856 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.739069 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.739172 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.739432 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.739532 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.739733 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.739829 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.740047 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.740175 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.740349 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.740491 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.740652 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.740763 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.740951 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.741049 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.741257 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.741351 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.741561 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.741649 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.741864 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.741951 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.742166 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.742254 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.742465 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.742555 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.742766 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.742865 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.743086 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.743187 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.743433 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.743531 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.743724 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.743818 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.744032 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.744147 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.744334 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.744446 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.744672 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.744769 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.744982 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.745078 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.745288 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.745396 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.745691 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.745789 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.746000 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.746101 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.746318 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.746404 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.746637 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.746726 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.746955 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.747053 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.747289 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.747381 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.747607 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.747703 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.747921 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.748011 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.748236 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.748333 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.748560 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.748656 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.748872 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.748961 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.749191 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.749279 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.749500 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.749587 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.749824 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.749912 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.750132 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.750220 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.750453 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.750540 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.750758 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.750897 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.751072 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.751210 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.751423 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.751537 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.751742 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.751830 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.752065 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.752153 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.752379 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.752480 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.752688 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.752789 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.753003 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.753107 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.753309 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.753408 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.753620 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.753710 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.753929 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.754030 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.754239 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.754347 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.754554 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.754642 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.754864 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.754952 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.755358 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.755516 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.755687 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.755955 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.756135 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.756324 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.756451 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.756646 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.756772 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.756967 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.757062 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.757281 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.757503 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.757641 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.757775 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.757912 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.758046 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.758188 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.758344 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.758508 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.758644 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.758822 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.758957 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.759144 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.759315 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.759483 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.759619 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.759809 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.759944 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.760110 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.760245 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.760415 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.760561 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.760728 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.760855 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.761038 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.761129 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.761345 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.761432 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.761652 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.761738 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.761955 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.762050 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.762268 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.762354 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.762571 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.762657 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.762873 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.762960 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.763174 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.763291 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.763508 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.763636 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.763818 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.763918 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.764125 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.764218 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.764442 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.764542 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.764757 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.764841 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.765056 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.765139 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.765670 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.765781 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.765972 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.766073 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.766282 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.766384 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.766586 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.766690 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.766886 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.766980 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.767188 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.767299 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.767526 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.767622 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.767847 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.767940 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.768148 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.768280 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.768458 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.768600 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.768773 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.768905 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.769075 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.769209 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.769380 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.769512 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.769682 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.769769 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.769989 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.770149 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.770296 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.770426 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.770576 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.770786 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.770963 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.771108 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.771265 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.771393 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.771565 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.771707 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.771877 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.772012 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.772187 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.772325 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.772505 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.772642 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.772811 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.772951 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.773121 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.773251 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.773428 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.773557 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.773728 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.773868 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.774037 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.774176 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.774354 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.774486 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.774664 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.774935 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.775027 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.775289 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.775391 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.775601 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.775708 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.775915 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.776011 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.776227 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.776315 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.776534 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.776631 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.776847 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.776933 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.777159 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.777245 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.777470 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.777602 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.777769 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.777859 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.778075 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.778164 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.778377 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.778644 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.778736 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.778970 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.779056 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.779294 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.779401 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.779599 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.779701 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.779940 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.780042 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.780206 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.780304 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.780507 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.780595 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.780808 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.780953 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.781140 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.781241 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.781439 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.781537 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.781745 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.781833 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.782044 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.782129 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.782344 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.782431 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.782645 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.782789 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.782948 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.783075 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.783270 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.783372 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.783578 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.783666 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.783882 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.784053 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.784184 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.784272 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.784551 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.784715 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.784846 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.784985 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.785117 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.785261 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.785405 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.785543 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.785700 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.785834 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.786013 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.786102 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.786366 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.786505 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.786691 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.786781 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.786999 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.787131 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.787328 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.787490 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.787647 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.787778 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.787919 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.788049 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.788214 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.788346 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.788502 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.788642 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.788808 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.788941 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.789120 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.789251 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.789429 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.789570 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.789735 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.789867 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.790035 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.790163 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.790341 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.790493 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.790625 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.790756 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.790954 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.791087 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.791256 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.791356 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.791566 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.791650 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.791866 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.791958 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.792167 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.792252 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.792472 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.792555 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.792772 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.792857 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.793078 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.793163 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.793374 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.793458 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.793676 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.793758 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.793976 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.794061 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.794276 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.794362 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.794576 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.794707 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.794880 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.794965 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.795202 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.795345 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.795509 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.795607 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.795819 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.795904 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.796125 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.796216 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.796430 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.796560 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.796724 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.796823 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.797026 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.797117 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.797328 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.797432 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.797634 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.797735 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.797925 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.798019 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.798224 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.798327 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.798533 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.798629 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.798831 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.798919 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.799130 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.799216 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.799461 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.799547 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.799765 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.799851 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.800067 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.800177 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.800366 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.800467 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.800665 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.800760 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.800962 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.801067 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.801260 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.801356 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.801557 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.801648 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.801854 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.801942 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.802208 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.802365 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.802498 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.802810 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.802967 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.803110 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.803416 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.803508 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.803758 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.803911 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.804059 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.804205 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.804416 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.804511 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.804723 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.804880 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.805034 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.805170 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.805351 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.805490 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.805666 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.805807 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.805973 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.806103 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.806276 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.806404 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.806580 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.806676 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.806894 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.806979 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.807199 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.807302 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.807531 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.807619 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.807836 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.807920 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.808139 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.808223 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.808457 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.808550 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.808769 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.808856 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.809080 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.809165 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.809399 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.809493 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.809720 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.809812 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.810037 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.810120 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.810337 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.810423 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.810643 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.810729 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.810951 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.811042 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.811273 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.811370 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.811582 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.811678 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.811890 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.811985 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.812194 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.812278 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.812501 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.812594 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.812811 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.812904 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.813120 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.813205 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.813429 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.813515 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.813733 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.813832 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.814040 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.814134 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.814344 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.814431 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.814644 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.814731 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.814957 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.815040 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.815279 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.815367 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.815585 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.815672 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.815889 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.815975 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.816189 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.816271 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.816499 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.816629 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.816797 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.816881 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.817111 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.817230 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.817424 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.817617 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.817791 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.817975 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.818154 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.818239 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.818398 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.818536 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.818708 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.818847 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.819013 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.819162 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.819363 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.819509 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.819676 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.819814 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.819982 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.820230 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.820317 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.820542 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.820627 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.820852 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.820936 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.821162 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.821256 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.821467 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.821577 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.821769 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.821891 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.822079 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.822205 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.822401 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.822513 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.822707 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.822811 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.823010 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.823127 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.823351 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.823469 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.823671 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.823785 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.823978 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.824075 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.824296 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.824535 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.824706 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.824806 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.825016 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.825123 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.825315 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.825413 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.825676 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.825763 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.825980 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.826067 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.826295 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.826442 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.826621 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.826722 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.826923 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.827015 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.827272 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.827361 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.827560 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.827647 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.827867 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.827951 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.828173 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.828265 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.828493 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.828586 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.828811 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.828896 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.829121 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.829214 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.829430 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.829528 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.829731 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.829897 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.830049 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.830207 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.830370 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.830516 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.830680 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.830839 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.830997 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.831159 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.831432 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.831538 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.831752 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.831839 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.832063 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.832161 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.832380 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.832471 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.832699 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.832789 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.832999 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.833084 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.833327 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.833412 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.833632 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.833723 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.833936 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.834031 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.834238 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.834332 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.834555 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.834639 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.834854 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.834945 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.835162 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.835278 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.835501 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.835586 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.835807 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.835895 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.836108 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.836195 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.836407 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.836550 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.836772 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.836869 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.837021 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.837108 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.837344 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.837428 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.837659 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.837752 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.837977 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.838062 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.838280 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.838363 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.838581 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.838674 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.838890 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.838981 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.839195 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.839336 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.839525 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.839619 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.839825 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.839909 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.840126 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.840209 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.840429 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.840527 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.840752 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.840837 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.841057 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.841142 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.841379 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.841472 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.841692 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.841780 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.841999 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.842089 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.842319 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.842404 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.842625 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.842710 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.842942 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.843025 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.843269 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.843387 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.843579 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.843677 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.843882 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.843978 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.844179 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.844269 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.844486 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.844576 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.844787 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.844889 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.845116 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.845217 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.845451 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.845550 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.845778 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.845877 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.846076 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.846162 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.846382 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.846470 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.846683 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.846782 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.847005 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.847102 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.847335 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.847433 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.847657 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.847768 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.847961 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.848056 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.848263 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.848365 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.848627 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.848733 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.848902 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.849083 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.849238 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.849545 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.849690 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.849853 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.849988 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.850158 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.850300 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.850455 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.850616 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.850778 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.850913 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.851046 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.851180 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.851378 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.851526 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.851702 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.851837 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.852013 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.852149 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.852322 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.852459 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.852615 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.852753 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.852918 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.853080 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.853257 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.853406 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.853599 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.853737 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.853885 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.854037 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.854184 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.854322 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.854469 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.854616 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.854778 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.854927 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.855096 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.855269 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.855469 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.855670 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.855809 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.856021 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.856158 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.856301 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.856441 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.856594 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.856754 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.856892 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.857042 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.857211 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.857298 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.857523 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.857609 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.857834 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.857920 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.858144 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.858233 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.858451 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.858536 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.858757 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.858844 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.859083 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.859349 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.859440 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.859684 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.859771 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.860003 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.860089 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.860317 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.860402 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.860631 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.860718 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.860946 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.861041 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.861261 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.861347 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.861573 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.861659 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.861886 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.861991 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.862194 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.862290 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.862500 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.862585 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.862813 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.862898 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.863126 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.863314 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.863479 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.863611 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.863779 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.863866 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.864090 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.864177 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.864450 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.864575 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.864777 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.864899 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.865191 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.865278 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.865506 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.865631 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.865820 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.865915 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.866142 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.866237 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.866455 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.866539 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.866773 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.866904 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.867080 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.867172 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.867475 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.867576 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.867814 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.867928 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.868043 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.868244 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.868357 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.868604 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.868712 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.868889 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.868975 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.869213 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.869307 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.869532 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.869664 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.869846 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.869942 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.870163 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.870257 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.870487 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.870581 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.870789 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.870882 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.871095 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.871192 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.871431 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.871530 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.871737 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.871952 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.872049 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.872263 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.872366 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.872598 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.872687 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.872923 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.873035 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.873238 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.873344 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.873541 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.873635 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.873862 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.874063 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.874190 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.874416 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.874510 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.874733 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.874827 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.875058 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.875146 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.875405 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.875493 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.875713 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.875800 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.876015 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.876108 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.876331 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.876415 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.876635 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.876719 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.876940 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.877039 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.877250 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.877338 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.877562 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.877778 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.877864 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.878129 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.878216 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.878440 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.878587 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.878747 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.878841 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.879047 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.879132 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.879387 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.879491 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.879691 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.879824 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.880036 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.880148 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.880366 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.880534 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.880669 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.880972 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.881061 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.881284 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.881380 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.881590 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.881682 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.881892 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.881992 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.882194 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.882299 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.882492 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.882577 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.882802 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.882887 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.883100 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.883184 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.883431 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.883530 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.883734 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.883827 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.884043 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.884129 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.884346 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.884451 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.884653 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.884781 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.884950 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.885042 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.885261 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.885358 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.885562 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.885654 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.885862 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.885948 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.886166 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.886258 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.886469 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.886555 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.886781 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.886866 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.887085 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.887171 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.887421 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.887522 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.887729 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.887815 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.888043 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.888137 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.888348 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.888573 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.888665 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.888949 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.889047 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.889268 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.889352 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.889570 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.889655 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.889874 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.889971 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.890190 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.890276 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.890811 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.890946 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.891113 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.891199 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.891459 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.891544 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.891766 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.891862 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.892078 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.892164 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.892388 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.892477 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.892697 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.892933 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.893097 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.893297 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.893382 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.893606 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.893698 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.893911 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.893998 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.894218 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.894314 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.894530 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.894621 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.894866 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.894951 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.895173 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.895313 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.895515 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.895634 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.895874 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.896001 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.896191 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.896329 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.896498 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.896587 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.896807 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.896895 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.897115 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.897200 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.897422 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.897514 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.897733 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.897827 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.898049 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.898262 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.898357 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.898469 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.898650 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.898750 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.898992 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.899111 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.899335 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.899448 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.899658 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.899753 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.899979 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.900123 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.900294 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.900422 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.900604 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.900732 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.900913 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.901045 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.901222 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.901310 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.901532 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.901666 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.901838 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.901965 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.902165 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.902295 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.902477 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.902567 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.902783 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.902928 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.903123 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.903316 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.903448 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.903552 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.903748 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.903833 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.904054 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.904188 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.904362 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.904450 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.904684 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.904790 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.905017 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.905103 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.905334 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.905422 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.905660 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.905757 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.905966 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.906099 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.906284 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.906380 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.906593 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.906688 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.906912 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.906998 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.907251 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.907354 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.907562 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.907654 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.907869 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.907955 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.908175 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.908260 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.908485 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.908576 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.908795 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.908881 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.909106 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.909201 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.909420 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.909525 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.909724 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.909810 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.910112 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.910265 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.910416 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.910560 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.910643 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.910729 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.910951 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.911048 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.911380 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.911667 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.911758 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.911895 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.911998 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.912079 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.912339 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.912441 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.912628 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.912732 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.912957 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.913046 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.913269 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.913402 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.913742 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.913845 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.913940 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.914027 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.914195 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.914392 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.914513 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.914641 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.914829 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.914971 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.915154 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.915336 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.915505 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.915639 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.915840 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.916019 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.916140 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.916332 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.916486 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.916650 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.916799 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.916966 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.917148 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.917297 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.917481 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.917614 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.917796 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.917934 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.918109 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.918247 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.918413 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.918562 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.918647 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 22 12:11:00.918881 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.919198 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.919550 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.919878 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.920204 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.920531 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.920878 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.921194 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.921542 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.921870 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.922184 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.922496 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.922801 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:11:00.923046 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 22 12:11:00.941055 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG oslo_db.sqlalchemy.engines [None req-bfd6a2bf-2a3b-4077-80f2-78f7d23b2e86 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102057) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 22 12:11:00.945276 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG oslo_db.sqlalchemy.engines [None req-877a9bbd-c1ad-44b4-9520-1255b5400884 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102058) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 22 12:11:01.009752 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.context [None req-bfd6a2bf-2a3b-4077-80f2-78f7d23b2e86 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),68c9e085-8a03-42f8-94bd-bbf67f51e1ae(cell1) {{(pid=102057) load_cells /opt/stack/nova/nova/context.py:464}} Nov 22 12:11:01.012994 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.context [None req-877a9bbd-c1ad-44b4-9520-1255b5400884 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),68c9e085-8a03-42f8-94bd-bbf67f51e1ae(cell1) {{(pid=102058) load_cells /opt/stack/nova/nova/context.py:464}} Nov 22 12:11:01.014009 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG oslo_concurrency.lockutils [None req-bfd6a2bf-2a3b-4077-80f2-78f7d23b2e86 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102057) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:11:01.015914 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG oslo_concurrency.lockutils [None req-bfd6a2bf-2a3b-4077-80f2-78f7d23b2e86 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102057) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:11:01.016740 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG oslo_concurrency.lockutils [None req-bfd6a2bf-2a3b-4077-80f2-78f7d23b2e86 None None] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102057) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:11:01.017519 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG oslo_concurrency.lockutils [None req-877a9bbd-c1ad-44b4-9520-1255b5400884 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:11:01.018734 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG oslo_concurrency.lockutils [None req-bfd6a2bf-2a3b-4077-80f2-78f7d23b2e86 None None] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102057) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:11:01.019114 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG oslo_concurrency.lockutils [None req-877a9bbd-c1ad-44b4-9520-1255b5400884 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:11:01.019983 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG oslo_concurrency.lockutils [None req-877a9bbd-c1ad-44b4-9520-1255b5400884 None None] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:11:01.022252 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG oslo_concurrency.lockutils [None req-877a9bbd-c1ad-44b4-9520-1255b5400884 None None] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:11:01.029739 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG oslo_db.sqlalchemy.engines [None req-bfd6a2bf-2a3b-4077-80f2-78f7d23b2e86 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102057) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 22 12:11:01.032482 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG oslo_db.sqlalchemy.engines [None req-bfd6a2bf-2a3b-4077-80f2-78f7d23b2e86 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102057) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 22 12:11:01.037809 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG oslo_db.sqlalchemy.engines [None req-877a9bbd-c1ad-44b4-9520-1255b5400884 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102058) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 22 12:11:01.040317 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG oslo_db.sqlalchemy.engines [None req-877a9bbd-c1ad-44b4-9520-1255b5400884 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102058) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 22 12:11:01.296553 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG oslo_db.sqlalchemy.engines [None req-bfd6a2bf-2a3b-4077-80f2-78f7d23b2e86 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102057) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 22 12:11:01.309270 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG oslo_db.sqlalchemy.engines [None req-877a9bbd-c1ad-44b4-9520-1255b5400884 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102058) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 22 12:11:01.649782 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: WARNING keystonemiddleware.auth_token [None req-bfd6a2bf-2a3b-4077-80f2-78f7d23b2e86 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 22 12:11:01.655408 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: WARNING keystonemiddleware.auth_token [None req-877a9bbd-c1ad-44b4-9520-1255b5400884 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 22 12:11:01.656452 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: WARNING keystonemiddleware.auth_token [None req-bfd6a2bf-2a3b-4077-80f2-78f7d23b2e86 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 22 12:11:01.662429 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: WARNING keystonemiddleware.auth_token [None req-877a9bbd-c1ad-44b4-9520-1255b5400884 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 22 12:11:01.887478 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: WARNING keystonemiddleware.auth_token [None req-bfd6a2bf-2a3b-4077-80f2-78f7d23b2e86 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 22 12:11:01.892960 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: WARNING keystonemiddleware.auth_token [None req-bfd6a2bf-2a3b-4077-80f2-78f7d23b2e86 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 22 12:11:01.893092 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: WARNING keystonemiddleware.auth_token [None req-877a9bbd-c1ad-44b4-9520-1255b5400884 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 22 12:11:01.898429 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5632f40f29c0 pid: 102057 (default app) Nov 22 12:11:01.898892 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: WARNING keystonemiddleware.auth_token [None req-877a9bbd-c1ad-44b4-9520-1255b5400884 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 22 12:11:01.901347 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi [None req-bfd6a2bf-2a3b-4077-80f2-78f7d23b2e86 None None] Calling method '>' {{(pid=102057) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:11:01.902467 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: INFO nova.api.openstack.requestlog [None req-bfd6a2bf-2a3b-4077-80f2-78f7d23b2e86 None None] 10.222.0.66 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.002486 Nov 22 12:11:01.902881 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: [pid: 102057|app: 0|req: 1/1] 10.222.0.66 () {50 vars in 788 bytes} [Mon Nov 22 12:11:01 2021] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 12:11:01.904333 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5632f40f29c0 pid: 102058 (default app) Nov 22 12:12:24.333053 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi [None req-bfd6a2bf-2a3b-4077-80f2-78f7d23b2e86 None None] Calling method '>' {{(pid=102057) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:12:24.334135 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: INFO nova.api.openstack.requestlog [None req-bfd6a2bf-2a3b-4077-80f2-78f7d23b2e86 None None] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001513 Nov 22 12:12:24.334769 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: [pid: 102057|app: 0|req: 2/2] 10.222.0.66 () {54 vars in 930 bytes} [Mon Nov 22 12:12:24 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 12:12:24.886164 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi [None req-81df0cb4-c63b-459a-b62b-2e9485270775 admin admin] Calling method '>' {{(pid=102058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:12:24.920239 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: INFO nova.api.openstack.requestlog [None req-81df0cb4-c63b-459a-b62b-2e9485270775 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.578329 Nov 22 12:12:24.921015 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: [pid: 102058|app: 0|req: 1/3] 10.222.0.66 () {60 vars in 1291 bytes} [Mon Nov 22 12:12:24 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 12:12:27.272375 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi [None req-bfd6a2bf-2a3b-4077-80f2-78f7d23b2e86 None None] Calling method '>' {{(pid=102057) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:12:27.273376 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: INFO nova.api.openstack.requestlog [None req-bfd6a2bf-2a3b-4077-80f2-78f7d23b2e86 None None] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001427 Nov 22 12:12:27.273771 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: [pid: 102057|app: 0|req: 3/4] 10.222.0.66 () {54 vars in 930 bytes} [Mon Nov 22 12:12:27 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 12:12:27.342689 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi [None req-19ecfc34-1340-4b4b-8098-771d66c47433 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "swap": 0, "id": "c1", "vcpus": 1, "ram": 256, "name": "cirros256", "os-flavor-access:is_public": true}} {{(pid=102058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:12:27.362471 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 12:12:27.362471 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: warnings.warn(msg) Nov 22 12:12:27.391734 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: INFO nova.api.openstack.requestlog [None req-19ecfc34-1340-4b4b-8098-771d66c47433 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.110716 Nov 22 12:12:27.392294 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: [pid: 102058|app: 0|req: 2/5] 10.222.0.66 () {64 vars in 1282 bytes} [Mon Nov 22 12:12:27 2021] POST /compute/v2.1/flavors => generated 407 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 12:12:27.811787 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi [None req-b0880fb7-d3f1-4489-81e1-69ab7628688b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102057) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:12:27.814536 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 12:12:27.814536 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: warnings.warn(msg) Nov 22 12:12:27.864963 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: INFO nova.api.openstack.requestlog [None req-b0880fb7-d3f1-4489-81e1-69ab7628688b admin admin] 10.222.0.66 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.463458 Nov 22 12:12:27.865779 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: [pid: 102057|app: 0|req: 4/6] 10.222.0.66 () {64 vars in 1335 bytes} [Mon Nov 22 12:12:27 2021] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:12:30.197501 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi [None req-19ecfc34-1340-4b4b-8098-771d66c47433 admin admin] Calling method '>' {{(pid=102058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:12:30.198741 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: INFO nova.api.openstack.requestlog [None req-19ecfc34-1340-4b4b-8098-771d66c47433 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001994 Nov 22 12:12:30.202764 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: [pid: 102058|app: 0|req: 3/7] 10.222.0.66 () {54 vars in 930 bytes} [Mon Nov 22 12:12:30 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 12:12:30.313967 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi [None req-602b8248-14c7-4d8f-a280-c17119f9d58a admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "name": "ds512M", "rxtx_factor": 1.0, "disk": 5, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 512, "id": "d1", "swap": 0}} {{(pid=102057) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:12:30.331933 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 12:12:30.331933 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: warnings.warn(msg) Nov 22 12:12:30.353447 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: INFO nova.api.openstack.requestlog [None req-602b8248-14c7-4d8f-a280-c17119f9d58a admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.146656 Nov 22 12:12:30.354371 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: [pid: 102057|app: 0|req: 5/8] 10.222.0.66 () {64 vars in 1282 bytes} [Mon Nov 22 12:12:30 2021] POST /compute/v2.1/flavors => generated 404 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 12:12:30.369044 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi [None req-7d28c82f-8d42-454f-bdc3-8bed28b02a03 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:12:30.370436 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 12:12:30.370436 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: warnings.warn(msg) Nov 22 12:12:30.422485 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: INFO nova.api.openstack.requestlog [None req-7d28c82f-8d42-454f-bdc3-8bed28b02a03 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.057449 Nov 22 12:12:30.423802 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: [pid: 102058|app: 0|req: 4/9] 10.222.0.66 () {64 vars in 1335 bytes} [Mon Nov 22 12:12:30 2021] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 12:12:32.754557 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi [None req-602b8248-14c7-4d8f-a280-c17119f9d58a admin admin] Calling method '>' {{(pid=102057) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:12:32.755606 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: INFO nova.api.openstack.requestlog [None req-602b8248-14c7-4d8f-a280-c17119f9d58a admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Nov 22 12:12:32.756232 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: [pid: 102057|app: 0|req: 6/10] 10.222.0.66 () {54 vars in 930 bytes} [Mon Nov 22 12:12:32 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 12:12:32.819667 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi [None req-0fd871ef-0d30-4798-903b-60def1b546d9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "ram": 1024, "rxtx_factor": 1.0, "id": "d2", "swap": 0, "os-flavor-access:is_public": true, "disk": 10, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=102058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:12:32.841181 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: INFO nova.api.openstack.requestlog [None req-0fd871ef-0d30-4798-903b-60def1b546d9 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.078282 Nov 22 12:12:32.843401 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: [pid: 102058|app: 0|req: 5/11] 10.222.0.66 () {64 vars in 1282 bytes} [Mon Nov 22 12:12:32 2021] POST /compute/v2.1/flavors => generated 404 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 12:12:32.856279 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi [None req-8315ddfa-1447-4de1-b4f4-247bcc4ccad8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102057) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:12:32.879806 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: INFO nova.api.openstack.requestlog [None req-8315ddfa-1447-4de1-b4f4-247bcc4ccad8 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029016 Nov 22 12:12:32.881074 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: [pid: 102057|app: 0|req: 7/12] 10.222.0.66 () {64 vars in 1335 bytes} [Mon Nov 22 12:12:32 2021] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:12:35.300442 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi [None req-0fd871ef-0d30-4798-903b-60def1b546d9 admin admin] Calling method '>' {{(pid=102058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:12:35.303093 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: INFO nova.api.openstack.requestlog [None req-0fd871ef-0d30-4798-903b-60def1b546d9 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003118 Nov 22 12:12:35.304103 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: [pid: 102058|app: 0|req: 6/13] 10.222.0.66 () {54 vars in 930 bytes} [Mon Nov 22 12:12:35 2021] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 12:12:35.393397 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi [None req-9e7a03c4-9265-41f5-9ddb-ee1c51f204c6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "name": "ds2G", "vcpus": 2, "swap": 0, "id": "d3", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "ram": 2048}} {{(pid=102057) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:12:35.426970 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: INFO nova.api.openstack.requestlog [None req-9e7a03c4-9265-41f5-9ddb-ee1c51f204c6 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.109717 Nov 22 12:12:35.428040 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: [pid: 102057|app: 0|req: 8/14] 10.222.0.66 () {64 vars in 1282 bytes} [Mon Nov 22 12:12:35 2021] POST /compute/v2.1/flavors => generated 404 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 12:12:35.440911 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi [None req-8b43fd53-6a3b-43ce-aa87-dd9ca4feb3d0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:12:35.466708 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: INFO nova.api.openstack.requestlog [None req-8b43fd53-6a3b-43ce-aa87-dd9ca4feb3d0 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029442 Nov 22 12:12:35.467157 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: [pid: 102058|app: 0|req: 7/15] 10.222.0.66 () {64 vars in 1335 bytes} [Mon Nov 22 12:12:35 2021] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:12:37.862436 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi [None req-9e7a03c4-9265-41f5-9ddb-ee1c51f204c6 admin admin] Calling method '>' {{(pid=102057) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:12:37.863570 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: INFO nova.api.openstack.requestlog [None req-9e7a03c4-9265-41f5-9ddb-ee1c51f204c6 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001520 Nov 22 12:12:37.864021 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: [pid: 102057|app: 0|req: 9/16] 10.222.0.66 () {54 vars in 930 bytes} [Mon Nov 22 12:12:37 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 12:12:37.929830 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi [None req-0316eedc-2744-4d37-ac44-4a4d5206783b admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d4", "name": "ds4G", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "ram": 4096, "swap": 0, "vcpus": 4}} {{(pid=102058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:12:37.949700 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: INFO nova.api.openstack.requestlog [None req-0316eedc-2744-4d37-ac44-4a4d5206783b admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.078532 Nov 22 12:12:37.957920 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: [pid: 102058|app: 0|req: 8/17] 10.222.0.66 () {64 vars in 1282 bytes} [Mon Nov 22 12:12:37 2021] POST /compute/v2.1/flavors => generated 404 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 12:12:37.963008 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi [None req-8dd82e60-b8ad-4420-b62d-d886fae809cf admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102057) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:12:37.988843 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: INFO nova.api.openstack.requestlog [None req-8dd82e60-b8ad-4420-b62d-d886fae809cf admin admin] 10.222.0.66 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029228 Nov 22 12:12:37.992689 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: [pid: 102057|app: 0|req: 10/18] 10.222.0.66 () {64 vars in 1335 bytes} [Mon Nov 22 12:12:37 2021] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:12:40.571562 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi [None req-0316eedc-2744-4d37-ac44-4a4d5206783b admin admin] Calling method '>' {{(pid=102058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:12:40.572580 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: INFO nova.api.openstack.requestlog [None req-0316eedc-2744-4d37-ac44-4a4d5206783b admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001543 Nov 22 12:12:40.572996 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: [pid: 102058|app: 0|req: 9/19] 10.222.0.66 () {54 vars in 930 bytes} [Mon Nov 22 12:12:40 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 12:12:40.644876 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi [None req-1b3ca7ee-ce43-427f-b71c-6e884e84c4ed admin admin] Calling method '>' {{(pid=102057) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:12:40.671050 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: INFO nova.api.openstack.requestlog [None req-1b3ca7ee-ce43-427f-b71c-6e884e84c4ed admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.090918 Nov 22 12:12:40.671674 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: [pid: 102057|app: 0|req: 11/20] 10.222.0.66 () {60 vars in 1291 bytes} [Mon Nov 22 12:12:40 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 12:12:43.208861 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi [None req-0316eedc-2744-4d37-ac44-4a4d5206783b admin admin] Calling method '>' {{(pid=102058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:12:43.209995 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: INFO nova.api.openstack.requestlog [None req-0316eedc-2744-4d37-ac44-4a4d5206783b admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001704 Nov 22 12:12:43.210484 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: [pid: 102058|app: 0|req: 10/21] 10.222.0.66 () {54 vars in 930 bytes} [Mon Nov 22 12:12:43 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 12:12:43.278204 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi [None req-2289bb43-b3ab-4873-adda-8e981b3bad55 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "1", "swap": 0, "os-flavor-access:is_public": true, "disk": 1, "ram": 512, "rxtx_factor": 1.0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.tiny"}} {{(pid=102057) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:12:43.300797 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: INFO nova.api.openstack.requestlog [None req-2289bb43-b3ab-4873-adda-8e981b3bad55 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.081508 Nov 22 12:12:43.301357 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: [pid: 102057|app: 0|req: 12/22] 10.222.0.66 () {64 vars in 1282 bytes} [Mon Nov 22 12:12:43 2021] POST /compute/v2.1/flavors => generated 402 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 12:12:43.318136 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi [None req-ddbf3b82-e525-4684-9f23-0c93230ae495 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:12:43.358125 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: INFO nova.api.openstack.requestlog [None req-ddbf3b82-e525-4684-9f23-0c93230ae495 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.047148 Nov 22 12:12:43.358702 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: [pid: 102058|app: 0|req: 11/23] 10.222.0.66 () {64 vars in 1332 bytes} [Mon Nov 22 12:12:43 2021] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:12:45.750346 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi [None req-2289bb43-b3ab-4873-adda-8e981b3bad55 admin admin] Calling method '>' {{(pid=102057) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:12:45.751401 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: INFO nova.api.openstack.requestlog [None req-2289bb43-b3ab-4873-adda-8e981b3bad55 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001490 Nov 22 12:12:45.751784 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: [pid: 102057|app: 0|req: 13/24] 10.222.0.66 () {54 vars in 930 bytes} [Mon Nov 22 12:12:45 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 12:12:45.816780 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi [None req-55dbdaef-3bfe-4957-b45c-86a33ad85167 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.small", "swap": 0, "disk": 20, "rxtx_factor": 1.0, "id": "2", "vcpus": 1, "ram": 2048}} {{(pid=102058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:12:45.836847 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: INFO nova.api.openstack.requestlog [None req-55dbdaef-3bfe-4957-b45c-86a33ad85167 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.078072 Nov 22 12:12:45.837425 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: [pid: 102058|app: 0|req: 12/25] 10.222.0.66 () {64 vars in 1282 bytes} [Mon Nov 22 12:12:45 2021] POST /compute/v2.1/flavors => generated 405 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 22 12:12:45.849797 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi [None req-c101fc9d-6d91-4cb7-8cee-7dc0e8a9e3f6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102057) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:12:45.874032 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: INFO nova.api.openstack.requestlog [None req-c101fc9d-6d91-4cb7-8cee-7dc0e8a9e3f6 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027812 Nov 22 12:12:45.874610 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: [pid: 102057|app: 0|req: 14/26] 10.222.0.66 () {64 vars in 1332 bytes} [Mon Nov 22 12:12:45 2021] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:12:48.166960 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi [None req-55dbdaef-3bfe-4957-b45c-86a33ad85167 admin admin] Calling method '>' {{(pid=102058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:12:48.168007 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: INFO nova.api.openstack.requestlog [None req-55dbdaef-3bfe-4957-b45c-86a33ad85167 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001513 Nov 22 12:12:48.168403 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: [pid: 102058|app: 0|req: 13/27] 10.222.0.66 () {54 vars in 930 bytes} [Mon Nov 22 12:12:48 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 12:12:48.233930 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi [None req-593ebe47-98bd-4044-925e-637c0c435085 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.medium", "ram": 4096, "os-flavor-access:is_public": true, "disk": 40, "vcpus": 2, "swap": 0, "id": "3"}} {{(pid=102057) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:12:48.253321 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: INFO nova.api.openstack.requestlog [None req-593ebe47-98bd-4044-925e-637c0c435085 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.077227 Nov 22 12:12:48.253881 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: [pid: 102057|app: 0|req: 15/28] 10.222.0.66 () {64 vars in 1282 bytes} [Mon Nov 22 12:12:48 2021] POST /compute/v2.1/flavors => generated 406 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 12:12:48.268364 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi [None req-847ac2ea-e24e-4ebb-8152-fe566c461458 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:12:48.298698 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: INFO nova.api.openstack.requestlog [None req-847ac2ea-e24e-4ebb-8152-fe566c461458 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036054 Nov 22 12:12:48.299345 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: [pid: 102058|app: 0|req: 14/29] 10.222.0.66 () {64 vars in 1332 bytes} [Mon Nov 22 12:12:48 2021] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:12:50.697091 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi [None req-593ebe47-98bd-4044-925e-637c0c435085 admin admin] Calling method '>' {{(pid=102057) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:12:50.698112 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: INFO nova.api.openstack.requestlog [None req-593ebe47-98bd-4044-925e-637c0c435085 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001489 Nov 22 12:12:50.698837 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: [pid: 102057|app: 0|req: 16/30] 10.222.0.66 () {54 vars in 930 bytes} [Mon Nov 22 12:12:50 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 12:12:50.770947 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi [None req-35ffd09a-54d3-40cd-8e7f-0131d22a2339 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.large", "vcpus": 4, "id": "4", "ram": 8192, "disk": 80, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:12:50.790741 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: INFO nova.api.openstack.requestlog [None req-35ffd09a-54d3-40cd-8e7f-0131d22a2339 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.085074 Nov 22 12:12:50.791324 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: [pid: 102058|app: 0|req: 15/31] 10.222.0.66 () {64 vars in 1282 bytes} [Mon Nov 22 12:12:50 2021] POST /compute/v2.1/flavors => generated 405 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 12:12:50.803601 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi [None req-02f8780c-a8b5-493c-ae84-ef43e0d86a80 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102057) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:12:50.832034 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: INFO nova.api.openstack.requestlog [None req-02f8780c-a8b5-493c-ae84-ef43e0d86a80 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032033 Nov 22 12:12:50.832643 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: [pid: 102057|app: 0|req: 17/32] 10.222.0.66 () {64 vars in 1332 bytes} [Mon Nov 22 12:12:50 2021] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:12:53.184484 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi [None req-35ffd09a-54d3-40cd-8e7f-0131d22a2339 admin admin] Calling method '>' {{(pid=102058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:12:53.185525 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: INFO nova.api.openstack.requestlog [None req-35ffd09a-54d3-40cd-8e7f-0131d22a2339 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001538 Nov 22 12:12:53.185929 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: [pid: 102058|app: 0|req: 16/33] 10.222.0.66 () {54 vars in 930 bytes} [Mon Nov 22 12:12:53 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 12:12:53.251290 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi [None req-e54a1642-7340-4d7c-ad9a-55cf6035bb72 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "id": "5", "swap": 0, "os-flavor-access:is_public": true, "vcpus": 8, "rxtx_factor": 1.0, "disk": 160, "ram": 16384, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=102057) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:12:53.278816 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: INFO nova.api.openstack.requestlog [None req-e54a1642-7340-4d7c-ad9a-55cf6035bb72 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.085832 Nov 22 12:12:53.280399 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: [pid: 102057|app: 0|req: 18/34] 10.222.0.66 () {64 vars in 1282 bytes} [Mon Nov 22 12:12:53 2021] POST /compute/v2.1/flavors => generated 408 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 22 12:12:53.294126 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi [None req-08403d7c-e7a7-47b4-b7a1-4b2341e9b3e4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:12:53.324294 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: INFO nova.api.openstack.requestlog [None req-08403d7c-e7a7-47b4-b7a1-4b2341e9b3e4 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034252 Nov 22 12:12:53.340538 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: [pid: 102058|app: 0|req: 17/35] 10.222.0.66 () {64 vars in 1332 bytes} [Mon Nov 22 12:12:53 2021] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:13:15.067529 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi [None req-e54a1642-7340-4d7c-ad9a-55cf6035bb72 admin admin] Calling method '>' {{(pid=102057) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:13:15.068563 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: INFO nova.api.openstack.requestlog [None req-e54a1642-7340-4d7c-ad9a-55cf6035bb72 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001551 Nov 22 12:13:15.068962 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: [pid: 102057|app: 0|req: 19/36] 10.222.0.66 () {54 vars in 930 bytes} [Mon Nov 22 12:13:15 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 12:13:15.134301 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi [None req-41a6b894-311f-4fa6-8db1-d7082396076c admin admin] Calling method '>' {{(pid=102058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:13:15.152198 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: INFO nova.api.openstack.requestlog [None req-41a6b894-311f-4fa6-8db1-d7082396076c admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.073878 Nov 22 12:13:15.152697 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: [pid: 102058|app: 0|req: 18/37] 10.222.0.66 () {60 vars in 1291 bytes} [Mon Nov 22 12:13:15 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 12:13:16.651514 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi [None req-e54a1642-7340-4d7c-ad9a-55cf6035bb72 admin admin] Calling method '>' {{(pid=102057) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:13:16.652516 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: INFO nova.api.openstack.requestlog [None req-e54a1642-7340-4d7c-ad9a-55cf6035bb72 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Nov 22 12:13:16.652917 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: [pid: 102057|app: 0|req: 20/38] 10.222.0.66 () {56 vars in 1074 bytes} [Mon Nov 22 12:13:16 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 12:13:16.843444 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi [None req-5072dc6b-9335-4826-b4bb-eea1ec684f7f admin admin] Calling method '>' {{(pid=102058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:13:16.849325 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: INFO nova.api.openstack.wsgi [None req-5072dc6b-9335-4826-b4bb-eea1ec684f7f admin admin] HTTP exception thrown: Flavor 42 could not be found. Nov 22 12:13:16.849888 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi [None req-5072dc6b-9335-4826-b4bb-eea1ec684f7f admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=102058) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 12:13:16.850679 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: INFO nova.api.openstack.requestlog [None req-5072dc6b-9335-4826-b4bb-eea1ec684f7f admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.061376 Nov 22 12:13:16.851212 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: [pid: 102058|app: 0|req: 19/39] 10.222.0.66 () {60 vars in 1190 bytes} [Mon Nov 22 12:13:16 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 22 12:13:16.862595 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi [None req-c8eaff6e-248d-4fa8-8ef0-a7575994ee5a admin admin] Calling method '>' {{(pid=102057) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:13:16.885062 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: INFO nova.api.openstack.requestlog [None req-c8eaff6e-248d-4fa8-8ef0-a7575994ee5a admin admin] 10.222.0.66 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026654 Nov 22 12:13:16.885643 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: [pid: 102057|app: 0|req: 21/40] 10.222.0.66 () {60 vars in 1210 bytes} [Mon Nov 22 12:13:16 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 12:13:16.896827 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi [None req-9a379f0d-f6c1-4d0d-aa05-aa71835a2f3b admin admin] Calling method '>' {{(pid=102058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:13:16.918481 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: INFO nova.api.openstack.requestlog [None req-9a379f0d-f6c1-4d0d-aa05-aa71835a2f3b admin admin] 10.222.0.66 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025418 Nov 22 12:13:16.919026 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: [pid: 102058|app: 0|req: 20/41] 10.222.0.66 () {60 vars in 1210 bytes} [Mon Nov 22 12:13:16 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 12:13:16.929652 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi [None req-8ccc83ae-16dd-4705-8f97-50d7d00872a3 admin admin] Calling method '>' {{(pid=102057) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:13:16.936400 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: INFO nova.api.openstack.wsgi [None req-8ccc83ae-16dd-4705-8f97-50d7d00872a3 admin admin] HTTP exception thrown: Flavor 42 could not be found. Nov 22 12:13:16.936976 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi [None req-8ccc83ae-16dd-4705-8f97-50d7d00872a3 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=102057) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 12:13:16.937776 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: INFO nova.api.openstack.requestlog [None req-8ccc83ae-16dd-4705-8f97-50d7d00872a3 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.011865 Nov 22 12:13:16.938349 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: [pid: 102057|app: 0|req: 22/42] 10.222.0.66 () {60 vars in 1190 bytes} [Mon Nov 22 12:13:16 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 22 12:13:18.323857 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi [None req-9a379f0d-f6c1-4d0d-aa05-aa71835a2f3b admin admin] Calling method '>' {{(pid=102058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:13:18.324894 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: INFO nova.api.openstack.requestlog [None req-9a379f0d-f6c1-4d0d-aa05-aa71835a2f3b admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Nov 22 12:13:18.325290 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: [pid: 102058|app: 0|req: 21/43] 10.222.0.66 () {56 vars in 1074 bytes} [Mon Nov 22 12:13:18 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 12:13:18.526305 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi [None req-4ab3bc44-1cc3-41a7-bfa0-ea6093cf2476 admin admin] Calling method '>' {{(pid=102057) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:13:18.532200 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: INFO nova.api.openstack.wsgi [None req-4ab3bc44-1cc3-41a7-bfa0-ea6093cf2476 admin admin] HTTP exception thrown: Flavor 84 could not be found. Nov 22 12:13:18.532761 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi [None req-4ab3bc44-1cc3-41a7-bfa0-ea6093cf2476 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=102057) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 12:13:18.533556 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: INFO nova.api.openstack.requestlog [None req-4ab3bc44-1cc3-41a7-bfa0-ea6093cf2476 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.066744 Nov 22 12:13:18.534101 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: [pid: 102057|app: 0|req: 23/44] 10.222.0.66 () {60 vars in 1190 bytes} [Mon Nov 22 12:13:18 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 22 12:13:18.544721 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi [None req-d48e8e83-0302-4216-87ab-c05ec08f14ea admin admin] Calling method '>' {{(pid=102058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:13:18.558753 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: INFO nova.api.openstack.requestlog [None req-d48e8e83-0302-4216-87ab-c05ec08f14ea admin admin] 10.222.0.66 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017566 Nov 22 12:13:18.559517 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: [pid: 102058|app: 0|req: 22/45] 10.222.0.66 () {60 vars in 1210 bytes} [Mon Nov 22 12:13:18 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 12:13:18.570147 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi [None req-5a6a632d-e4f9-4d4a-b4dd-02b0cb1301cd admin admin] Calling method '>' {{(pid=102057) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:13:18.583577 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: INFO nova.api.openstack.requestlog [None req-5a6a632d-e4f9-4d4a-b4dd-02b0cb1301cd admin admin] 10.222.0.66 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017020 Nov 22 12:13:18.584134 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: [pid: 102057|app: 0|req: 24/46] 10.222.0.66 () {60 vars in 1210 bytes} [Mon Nov 22 12:13:18 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 22 12:13:18.594161 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi [None req-0272be0b-39f7-4752-ab74-674d2fbdafde admin admin] Calling method '>' {{(pid=102058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:13:18.599665 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: INFO nova.api.openstack.wsgi [None req-0272be0b-39f7-4752-ab74-674d2fbdafde admin admin] HTTP exception thrown: Flavor 84 could not be found. Nov 22 12:13:18.600227 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi [None req-0272be0b-39f7-4752-ab74-674d2fbdafde admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=102058) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 12:13:18.601009 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: INFO nova.api.openstack.requestlog [None req-0272be0b-39f7-4752-ab74-674d2fbdafde admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.010543 Nov 22 12:13:18.601509 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: [pid: 102058|app: 0|req: 23/47] 10.222.0.66 () {60 vars in 1190 bytes} [Mon Nov 22 12:13:18 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 22 12:13:20.025791 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi [None req-5a6a632d-e4f9-4d4a-b4dd-02b0cb1301cd admin admin] Calling method '>' {{(pid=102057) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:13:20.026790 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: INFO nova.api.openstack.requestlog [None req-5a6a632d-e4f9-4d4a-b4dd-02b0cb1301cd admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 Nov 22 12:13:20.027187 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: [pid: 102057|app: 0|req: 25/48] 10.222.0.66 () {56 vars in 1074 bytes} [Mon Nov 22 12:13:20 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 12:13:20.231431 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi [None req-a3cd5e26-1bed-4b3d-bdf7-d149e3ed8dd0 admin admin] Calling method '>' {{(pid=102058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:13:20.237897 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: INFO nova.api.openstack.wsgi [None req-a3cd5e26-1bed-4b3d-bdf7-d149e3ed8dd0 admin admin] HTTP exception thrown: Flavor 451 could not be found. Nov 22 12:13:20.238663 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi [None req-a3cd5e26-1bed-4b3d-bdf7-d149e3ed8dd0 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=102058) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 12:13:20.239870 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: INFO nova.api.openstack.requestlog [None req-a3cd5e26-1bed-4b3d-bdf7-d149e3ed8dd0 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.073606 Nov 22 12:13:20.240473 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: [pid: 102058|app: 0|req: 24/49] 10.222.0.66 () {60 vars in 1193 bytes} [Mon Nov 22 12:13:20 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 22 12:13:20.251949 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi [None req-d6a6e97b-1092-474b-a946-bd8ec7f80299 admin admin] Calling method '>' {{(pid=102057) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:13:20.266657 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: INFO nova.api.openstack.requestlog [None req-d6a6e97b-1092-474b-a946-bd8ec7f80299 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018203 Nov 22 12:13:20.267213 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: [pid: 102057|app: 0|req: 26/50] 10.222.0.66 () {60 vars in 1210 bytes} [Mon Nov 22 12:13:20 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 12:13:20.280984 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi [None req-acb05132-ad21-49c8-b631-5d816e4d1983 admin admin] Calling method '>' {{(pid=102058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:13:20.296790 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: INFO nova.api.openstack.requestlog [None req-acb05132-ad21-49c8-b631-5d816e4d1983 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.022127 Nov 22 12:13:20.297361 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: [pid: 102058|app: 0|req: 25/51] 10.222.0.66 () {60 vars in 1210 bytes} [Mon Nov 22 12:13:20 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 12:13:20.312436 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi [None req-6d9f4cb3-16bc-4dc7-9f53-7e7d7186ff7d admin admin] Calling method '>' {{(pid=102057) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:13:20.320608 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: INFO nova.api.openstack.wsgi [None req-6d9f4cb3-16bc-4dc7-9f53-7e7d7186ff7d admin admin] HTTP exception thrown: Flavor 451 could not be found. Nov 22 12:13:20.321439 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi [None req-6d9f4cb3-16bc-4dc7-9f53-7e7d7186ff7d admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=102057) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 12:13:20.322209 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: INFO nova.api.openstack.requestlog [None req-6d9f4cb3-16bc-4dc7-9f53-7e7d7186ff7d admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.015166 Nov 22 12:13:20.322830 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: [pid: 102057|app: 0|req: 27/52] 10.222.0.66 () {60 vars in 1193 bytes} [Mon Nov 22 12:13:20 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 22 12:13:21.783732 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi [None req-acb05132-ad21-49c8-b631-5d816e4d1983 admin admin] Calling method '>' {{(pid=102058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:13:21.784735 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: INFO nova.api.openstack.requestlog [None req-acb05132-ad21-49c8-b631-5d816e4d1983 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001522 Nov 22 12:13:21.785122 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: [pid: 102058|app: 0|req: 26/53] 10.222.0.66 () {56 vars in 1074 bytes} [Mon Nov 22 12:13:21 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 12:13:21.990982 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi [None req-5588c52e-8875-464c-8644-7000df93babf admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102057) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:13:22.019446 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: INFO nova.api.openstack.requestlog [None req-5588c52e-8875-464c-8644-7000df93babf admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.092047 Nov 22 12:13:22.020734 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: [pid: 102057|app: 0|req: 28/54] 10.222.0.66 () {64 vars in 1235 bytes} [Mon Nov 22 12:13:21 2021] POST /compute/v2.1/flavors => generated 404 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 12:13:23.483600 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi [None req-acb05132-ad21-49c8-b631-5d816e4d1983 admin admin] Calling method '>' {{(pid=102058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:13:23.484599 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: INFO nova.api.openstack.requestlog [None req-acb05132-ad21-49c8-b631-5d816e4d1983 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 Nov 22 12:13:23.484994 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: [pid: 102058|app: 0|req: 27/55] 10.222.0.66 () {56 vars in 1074 bytes} [Mon Nov 22 12:13:23 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 12:13:23.681042 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi [None req-f32a0d67-491c-40f4-a12f-150983e6d32d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102057) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:13:23.712476 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: INFO nova.api.openstack.requestlog [None req-f32a0d67-491c-40f4-a12f-150983e6d32d admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.088203 Nov 22 12:13:23.713013 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: [pid: 102057|app: 0|req: 29/56] 10.222.0.66 () {64 vars in 1235 bytes} [Mon Nov 22 12:13:23 2021] POST /compute/v2.1/flavors => generated 405 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 12:13:25.124447 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi [None req-acb05132-ad21-49c8-b631-5d816e4d1983 admin admin] Calling method '>' {{(pid=102058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:13:25.125444 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: INFO nova.api.openstack.requestlog [None req-acb05132-ad21-49c8-b631-5d816e4d1983 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001430 Nov 22 12:13:25.125857 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: [pid: 102058|app: 0|req: 28/57] 10.222.0.66 () {56 vars in 1074 bytes} [Mon Nov 22 12:13:25 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 12:13:25.322878 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi [None req-14ea7ba4-0795-4a6f-8f09-a88de240f729 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102057) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:13:25.345403 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: INFO nova.api.openstack.requestlog [None req-14ea7ba4-0795-4a6f-8f09-a88de240f729 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.081666 Nov 22 12:13:25.346242 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: [pid: 102057|app: 0|req: 30/58] 10.222.0.66 () {64 vars in 1235 bytes} [Mon Nov 22 12:13:25 2021] POST /compute/v2.1/flavors => generated 407 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 12:13:26.747815 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi [None req-acb05132-ad21-49c8-b631-5d816e4d1983 admin admin] Calling method '>' {{(pid=102058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:13:26.749092 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: INFO nova.api.openstack.requestlog [None req-acb05132-ad21-49c8-b631-5d816e4d1983 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001797 Nov 22 12:13:26.749577 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: [pid: 102058|app: 0|req: 29/59] 10.222.0.66 () {56 vars in 1074 bytes} [Mon Nov 22 12:13:26 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 12:13:26.947305 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi [None req-a362a920-46b5-4ef1-a49a-0c27a3657a98 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102057) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:13:26.967659 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: INFO nova.api.openstack.requestlog [None req-a362a920-46b5-4ef1-a49a-0c27a3657a98 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.076356 Nov 22 12:13:26.968209 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: [pid: 102057|app: 0|req: 31/60] 10.222.0.66 () {64 vars in 1235 bytes} [Mon Nov 22 12:13:26 2021] POST /compute/v2.1/flavors => generated 409 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 12:13:28.403885 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi [None req-acb05132-ad21-49c8-b631-5d816e4d1983 admin admin] Calling method '>' {{(pid=102058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:13:28.404925 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: INFO nova.api.openstack.requestlog [None req-acb05132-ad21-49c8-b631-5d816e4d1983 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001496 Nov 22 12:13:28.405319 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: [pid: 102058|app: 0|req: 30/61] 10.222.0.66 () {56 vars in 1074 bytes} [Mon Nov 22 12:13:28 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 12:13:28.607462 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi [None req-b220fb60-e8c3-4e93-b4c0-828d8418a976 admin admin] Calling method '>' {{(pid=102057) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:13:28.627018 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: INFO nova.api.openstack.requestlog [None req-b220fb60-e8c3-4e93-b4c0-828d8418a976 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.081439 Nov 22 12:13:28.627583 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: [pid: 102057|app: 0|req: 32/62] 10.222.0.66 () {60 vars in 1202 bytes} [Mon Nov 22 12:13:28 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 12:14:16.645119 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi [None req-acb05132-ad21-49c8-b631-5d816e4d1983 admin admin] Calling method '>' {{(pid=102058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:14:16.646122 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: INFO nova.api.openstack.requestlog [None req-acb05132-ad21-49c8-b631-5d816e4d1983 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001690 Nov 22 12:14:16.646522 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: [pid: 102058|app: 0|req: 31/63] 10.222.0.66 () {54 vars in 930 bytes} [Mon Nov 22 12:14:16 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 12:14:16.709828 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi [None req-4c4d9c66-c247-4320-9fdc-1f26d9b68337 admin admin] Calling method '>' {{(pid=102057) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:14:16.728990 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: INFO nova.api.openstack.requestlog [None req-4c4d9c66-c247-4320-9fdc-1f26d9b68337 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.075539 Nov 22 12:14:16.729522 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: [pid: 102057|app: 0|req: 33/64] 10.222.0.66 () {60 vars in 1291 bytes} [Mon Nov 22 12:14:16 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 12:14:16.760334 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi [None req-aa84d04c-c0c0-472e-a634-2543285b5620 admin admin] Calling method '>' {{(pid=102058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:14:16.768815 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: INFO nova.api.openstack.requestlog [None req-aa84d04c-c0c0-472e-a634-2543285b5620 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012155 Nov 22 12:14:16.769345 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: [pid: 102058|app: 0|req: 32/65] 10.222.0.66 () {60 vars in 1282 bytes} [Mon Nov 22 12:14:16 2021] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:14:16.781539 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi [None req-be40e3f2-d7af-474b-baca-8099c90d9cec admin admin] Calling method '>' {{(pid=102057) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:14:16.791046 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: INFO nova.api.openstack.requestlog [None req-be40e3f2-d7af-474b-baca-8099c90d9cec admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012952 Nov 22 12:14:16.791704 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: [pid: 102057|app: 0|req: 34/66] 10.222.0.66 () {60 vars in 1285 bytes} [Mon Nov 22 12:14:16 2021] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 12:14:16.804375 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi [None req-5a00a93d-0509-41c7-bce0-74f3311bd89a admin admin] Calling method '>' {{(pid=102058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:14:16.812418 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: INFO nova.api.openstack.requestlog [None req-5a00a93d-0509-41c7-bce0-74f3311bd89a admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011653 Nov 22 12:14:16.812956 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: [pid: 102058|app: 0|req: 33/67] 10.222.0.66 () {60 vars in 1285 bytes} [Mon Nov 22 12:14:16 2021] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:14:16.825210 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi [None req-5cfaf0b3-a25e-42c7-9058-89715b0dc6b4 admin admin] Calling method '>' {{(pid=102057) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:14:16.833753 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: INFO nova.api.openstack.requestlog [None req-5cfaf0b3-a25e-42c7-9058-89715b0dc6b4 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012168 Nov 22 12:14:16.834278 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: [pid: 102057|app: 0|req: 35/68] 10.222.0.66 () {60 vars in 1282 bytes} [Mon Nov 22 12:14:16 2021] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:15:40.949786 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi [None req-70169552-727a-4f8d-ae6a-140436e60b13 tempest-verify_tempest_config-1679514741 tempest-verify_tempest_config-1679514741-project] Calling method '>' {{(pid=102058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:15:40.953986 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: INFO nova.api.openstack.requestlog [None req-70169552-727a-4f8d-ae6a-140436e60b13 tempest-verify_tempest_config-1679514741 tempest-verify_tempest_config-1679514741-project] 10.222.0.66 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.145933 Nov 22 12:15:40.955284 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: [pid: 102058|app: 0|req: 34/69] 10.222.0.66 () {58 vars in 1133 bytes} [Mon Nov 22 12:15:40 2021] GET /compute/v2.1/extensions => generated 22700 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 12:17:12.063278 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi [None req-5cfaf0b3-a25e-42c7-9058-89715b0dc6b4 admin admin] Calling method '>' {{(pid=102057) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:17:12.064315 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: INFO nova.api.openstack.requestlog [None req-5cfaf0b3-a25e-42c7-9058-89715b0dc6b4 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Nov 22 12:17:12.064709 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: [pid: 102057|app: 0|req: 36/70] 10.222.0.66 () {56 vars in 1074 bytes} [Mon Nov 22 12:17:12 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 12:17:12.333184 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi [None req-9a2c7fbc-6959-4433-a29e-ac5b2cc49557 admin admin] Calling method '>' {{(pid=102058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:17:12.334377 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 12:17:12.334377 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: warnings.warn(msg) Nov 22 12:17:12.336020 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG oslo_concurrency.lockutils [None req-9a2c7fbc-6959-4433-a29e-ac5b2cc49557 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:17:12.336457 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG oslo_concurrency.lockutils [None req-9a2c7fbc-6959-4433-a29e-ac5b2cc49557 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:17:12.337298 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG oslo_concurrency.lockutils [None req-9a2c7fbc-6959-4433-a29e-ac5b2cc49557 admin admin] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:17:12.337814 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG oslo_concurrency.lockutils [None req-9a2c7fbc-6959-4433-a29e-ac5b2cc49557 admin admin] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:17:12.371854 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: INFO nova.api.openstack.requestlog [None req-9a2c7fbc-6959-4433-a29e-ac5b2cc49557 admin admin] 10.222.0.66 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.163527 Nov 22 12:17:12.372427 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: [pid: 102058|app: 0|req: 35/71] 10.222.0.66 () {60 vars in 1193 bytes} [Mon Nov 22 12:17:12 2021] GET /compute/v2.1/os-services => generated 794 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 12:17:13.805625 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi [None req-5cfaf0b3-a25e-42c7-9058-89715b0dc6b4 admin admin] Calling method '>' {{(pid=102057) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:17:13.806657 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: INFO nova.api.openstack.requestlog [None req-5cfaf0b3-a25e-42c7-9058-89715b0dc6b4 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Nov 22 12:17:13.807048 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: [pid: 102057|app: 0|req: 37/72] 10.222.0.66 () {56 vars in 1074 bytes} [Mon Nov 22 12:17:13 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 12:17:14.016925 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi [None req-de48efc5-676f-4e0a-9e7d-30652b67f0cd admin admin] Calling method '>' {{(pid=102058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:17:14.018126 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 12:17:14.018126 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: warnings.warn(msg) Nov 22 12:17:14.019855 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG oslo_concurrency.lockutils [None req-de48efc5-676f-4e0a-9e7d-30652b67f0cd admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:17:14.020432 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG oslo_concurrency.lockutils [None req-de48efc5-676f-4e0a-9e7d-30652b67f0cd admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:17:14.021737 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG oslo_concurrency.lockutils [None req-de48efc5-676f-4e0a-9e7d-30652b67f0cd admin admin] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:17:14.022527 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG oslo_concurrency.lockutils [None req-de48efc5-676f-4e0a-9e7d-30652b67f0cd admin admin] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:17:14.049598 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: INFO nova.api.openstack.requestlog [None req-de48efc5-676f-4e0a-9e7d-30652b67f0cd admin admin] 10.222.0.66 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.101500 Nov 22 12:17:14.050151 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: [pid: 102058|app: 0|req: 36/73] 10.222.0.66 () {60 vars in 1193 bytes} [Mon Nov 22 12:17:13 2021] GET /compute/v2.1/os-services => generated 1014 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 12:17:25.902537 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi [None req-5cfaf0b3-a25e-42c7-9058-89715b0dc6b4 admin admin] Calling method '>' {{(pid=102057) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:17:25.903578 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: INFO nova.api.openstack.requestlog [None req-5cfaf0b3-a25e-42c7-9058-89715b0dc6b4 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001484 Nov 22 12:17:25.903977 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: [pid: 102057|app: 0|req: 38/74] 10.222.0.66 () {56 vars in 1074 bytes} [Mon Nov 22 12:17:25 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 12:17:26.102839 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi [None req-b246e6a0-1450-445a-8dac-96e6aaa8e0a1 admin admin] Calling method '>' {{(pid=102058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:17:26.104092 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 12:17:26.104092 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: warnings.warn(msg) Nov 22 12:17:26.105641 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG oslo_concurrency.lockutils [None req-b246e6a0-1450-445a-8dac-96e6aaa8e0a1 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:17:26.106081 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG oslo_concurrency.lockutils [None req-b246e6a0-1450-445a-8dac-96e6aaa8e0a1 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:17:26.106918 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG oslo_concurrency.lockutils [None req-b246e6a0-1450-445a-8dac-96e6aaa8e0a1 admin admin] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:17:26.107345 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG oslo_concurrency.lockutils [None req-b246e6a0-1450-445a-8dac-96e6aaa8e0a1 admin admin] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:17:26.129595 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: INFO nova.api.openstack.requestlog [None req-b246e6a0-1450-445a-8dac-96e6aaa8e0a1 admin admin] 10.222.0.66 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.085204 Nov 22 12:17:26.130180 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: [pid: 102058|app: 0|req: 37/75] 10.222.0.66 () {60 vars in 1193 bytes} [Mon Nov 22 12:17:26 2021] GET /compute/v2.1/os-services => generated 1038 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 12:17:27.582824 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: DEBUG nova.api.openstack.wsgi [None req-5cfaf0b3-a25e-42c7-9058-89715b0dc6b4 admin admin] Calling method '>' {{(pid=102057) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:17:27.584139 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: INFO nova.api.openstack.requestlog [None req-5cfaf0b3-a25e-42c7-9058-89715b0dc6b4 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001864 Nov 22 12:17:27.584593 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: [pid: 102057|app: 0|req: 39/76] 10.222.0.66 () {56 vars in 1074 bytes} [Mon Nov 22 12:17:27 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 12:17:27.793604 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG nova.api.openstack.wsgi [None req-c1b0dddf-f1b0-477b-aec6-b96aaf7485b7 admin admin] Calling method '>' {{(pid=102058) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:17:27.794756 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 12:17:27.794756 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: warnings.warn(msg) Nov 22 12:17:27.796308 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG oslo_concurrency.lockutils [None req-c1b0dddf-f1b0-477b-aec6-b96aaf7485b7 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:17:27.796749 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG oslo_concurrency.lockutils [None req-c1b0dddf-f1b0-477b-aec6-b96aaf7485b7 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:17:27.798042 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG oslo_concurrency.lockutils [None req-c1b0dddf-f1b0-477b-aec6-b96aaf7485b7 admin admin] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:17:27.798042 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: DEBUG oslo_concurrency.lockutils [None req-c1b0dddf-f1b0-477b-aec6-b96aaf7485b7 admin admin] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102058) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:17:27.819763 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: INFO nova.api.openstack.requestlog [None req-c1b0dddf-f1b0-477b-aec6-b96aaf7485b7 admin admin] 10.222.0.66 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.094022 Nov 22 12:17:27.820323 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: [pid: 102058|app: 0|req: 38/77] 10.222.0.66 () {60 vars in 1193 bytes} [Mon Nov 22 12:17:27 2021] GET /compute/v2.1/os-services => generated 1038 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 12:18:24.323212 dv-cinder-768458-13-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Nov 22 12:18:24.324167 dv-cinder-768458-13-iscsi devstack@n-api.service[102056]: Mon Nov 22 12:18:24 2021 - graceful shutdown triggered... Nov 22 12:18:24.324683 dv-cinder-768458-13-iscsi devstack@n-api.service[102057]: Gracefully killing worker 1 (pid: 102057)... Nov 22 12:18:24.325043 dv-cinder-768458-13-iscsi devstack@n-api.service[102058]: Gracefully killing worker 2 (pid: 102058)... Nov 22 12:18:25.325397 dv-cinder-768458-13-iscsi devstack@n-api.service[102056]: worker 1 buried after 1 seconds Nov 22 12:18:25.325397 dv-cinder-768458-13-iscsi devstack@n-api.service[102056]: worker 2 buried after 1 seconds Nov 22 12:18:25.325397 dv-cinder-768458-13-iscsi devstack@n-api.service[102056]: goodbye to uWSGI. Nov 22 12:18:25.327110 dv-cinder-768458-13-iscsi systemd[1]: devstack@n-api.service: Succeeded. Nov 22 12:18:25.327714 dv-cinder-768458-13-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Nov 22 12:18:25.331062 dv-cinder-768458-13-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Nov 22 12:18:25.340963 dv-cinder-768458-13-iscsi devstack@n-api.service[116249]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Nov 22 12:18:25.342972 dv-cinder-768458-13-iscsi devstack@n-api.service[116249]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Nov 22 12:18:25 2021] *** Nov 22 12:18:25.342972 dv-cinder-768458-13-iscsi devstack@n-api.service[116249]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Nov 22 12:18:25.342972 dv-cinder-768458-13-iscsi devstack@n-api.service[116249]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Nov 22 12:18:25.342972 dv-cinder-768458-13-iscsi devstack@n-api.service[116249]: nodename: dv-cinder-768458-13-iscsi Nov 22 12:18:25.342972 dv-cinder-768458-13-iscsi devstack@n-api.service[116249]: machine: x86_64 Nov 22 12:18:25.342972 dv-cinder-768458-13-iscsi devstack@n-api.service[116249]: clock source: unix Nov 22 12:18:25.342972 dv-cinder-768458-13-iscsi devstack@n-api.service[116249]: pcre jit disabled Nov 22 12:18:25.342972 dv-cinder-768458-13-iscsi devstack@n-api.service[116249]: detected number of CPU cores: 4 Nov 22 12:18:25.342972 dv-cinder-768458-13-iscsi devstack@n-api.service[116249]: current working directory: / Nov 22 12:18:25.342972 dv-cinder-768458-13-iscsi devstack@n-api.service[116249]: detected binary path: /usr/bin/uwsgi-core Nov 22 12:18:25.342972 dv-cinder-768458-13-iscsi devstack@n-api.service[116249]: your processes number limit is 47680 Nov 22 12:18:25.343724 dv-cinder-768458-13-iscsi devstack@n-api.service[116249]: your memory page size is 4096 bytes Nov 22 12:18:25.343724 dv-cinder-768458-13-iscsi devstack@n-api.service[116249]: detected max file descriptor number: 2048 Nov 22 12:18:25.343724 dv-cinder-768458-13-iscsi devstack@n-api.service[116249]: lock engine: pthread robust mutexes Nov 22 12:18:25.343724 dv-cinder-768458-13-iscsi devstack@n-api.service[116249]: thunder lock: enabled Nov 22 12:18:25.343724 dv-cinder-768458-13-iscsi devstack@n-api.service[116249]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Nov 22 12:18:25.343724 dv-cinder-768458-13-iscsi devstack@n-api.service[116249]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Nov 22 12:18:25.388933 dv-cinder-768458-13-iscsi devstack@n-api.service[116249]: Python main interpreter initialized at 0x563bd5a1a9c0 Nov 22 12:18:25.388933 dv-cinder-768458-13-iscsi devstack@n-api.service[116249]: python threads support enabled Nov 22 12:18:25.388933 dv-cinder-768458-13-iscsi devstack@n-api.service[116249]: your server socket listen backlog is limited to 100 connections Nov 22 12:18:25.388933 dv-cinder-768458-13-iscsi devstack@n-api.service[116249]: your mercy for graceful operations on workers is 90 seconds Nov 22 12:18:25.389355 dv-cinder-768458-13-iscsi devstack@n-api.service[116249]: mapped 403077 bytes (393 KB) for 2 cores Nov 22 12:18:25.389355 dv-cinder-768458-13-iscsi devstack@n-api.service[116249]: *** Operational MODE: preforking *** Nov 22 12:18:25.389687 dv-cinder-768458-13-iscsi devstack@n-api.service[116249]: *** uWSGI is running in multiple interpreter mode *** Nov 22 12:18:25.389687 dv-cinder-768458-13-iscsi devstack@n-api.service[116249]: spawned uWSGI master process (pid: 116249) Nov 22 12:18:25.389899 dv-cinder-768458-13-iscsi systemd[1]: Started Devstack devstack@n-api.service. Nov 22 12:18:25.390451 dv-cinder-768458-13-iscsi devstack@n-api.service[116249]: spawned uWSGI worker 1 (pid: 116272, cores: 1) Nov 22 12:18:25.392347 dv-cinder-768458-13-iscsi devstack@n-api.service[116249]: spawned uWSGI worker 2 (pid: 116273, cores: 1) Nov 22 12:18:25.392347 dv-cinder-768458-13-iscsi devstack@n-api.service[116249]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Nov 22 12:18:27.157633 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 22 12:18:27.157633 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: from cryptography.utils import int_from_bytes Nov 22 12:18:27.158378 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 22 12:18:27.158378 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: from cryptography.utils import int_from_bytes Nov 22 12:18:27.160059 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 22 12:18:27.160059 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: from cryptography.utils import int_from_bytes Nov 22 12:18:27.160566 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 22 12:18:27.160566 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: from cryptography.utils import int_from_bytes Nov 22 12:18:29.523951 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 22 12:18:29.524709 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 22 12:18:29.524813 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 22 12:18:29.525224 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 22 12:18:29.525612 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 22 12:18:29.525949 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.526271 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.526691 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.527062 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.527780 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.528119 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.528499 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.528871 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.529227 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.529617 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.529879 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.530300 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-768458-13-iscsi {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.530585 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.531802 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.531802 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.531802 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.532284 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.532433 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.532736 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.533265 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.534583 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.534583 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.534583 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.534876 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.535269 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.535624 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.535995 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.536332 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.536754 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.537144 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.537578 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-768458-13-iscsi {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.538143 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.538593 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.538962 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.539492 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.539887 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.540289 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.540755 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.541195 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.541575 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.542014 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.542390 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.542753 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.543108 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.543506 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.543865 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.544516 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.544932 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.545529 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.553179 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.553179 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.553179 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.553179 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.553179 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.553179 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.553179 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.554080 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.554080 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.554080 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.554080 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.554080 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.554080 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.554080 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.554080 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.555043 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.555043 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.555043 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.555043 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.555043 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.555043 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.555043 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.555043 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.555868 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.66 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.555868 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.66 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.555868 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.555868 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.555868 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.555868 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.556590 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.556590 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.556962 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.557556 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.558079 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.558633 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.559259 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.559615 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.559951 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.560328 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.560731 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.561114 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.561502 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.562104 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.562463 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.562887 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.563317 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.563740 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.564082 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.564510 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.565031 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.565464 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.565843 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.566239 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.566582 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.566945 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.567503 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.567976 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.568495 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.568867 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.569279 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.569865 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.570337 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.570734 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.571179 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.571515 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.571893 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.572277 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.572670 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.573067 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.573477 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.573864 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.574254 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.574648 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.574998 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.575403 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.575840 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.576131 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.576461 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.576811 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.577140 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.577496 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.577863 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.578245 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.578646 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.579060 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.579526 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.579701 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.580110 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.580534 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.580936 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.581331 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.581692 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.582111 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.582549 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.582899 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.583468 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.583797 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.584226 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.584564 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.585006 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.585450 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.586039 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.586581 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.586781 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 22 12:18:29.587551 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 22 12:18:29.587849 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.587849 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.588140 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 22 12:18:29.588398 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.588550 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 22 12:18:29.588993 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.589164 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 22 12:18:29.589482 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.590111 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.590316 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.590490 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.590647 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.590988 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.591146 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.591437 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.591599 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.591881 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.592031 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.592390 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.592390 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.592749 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.592983 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.593161 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.593401 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.593593 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.593744 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.593992 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.594260 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.594471 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.594632 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-768458-13-iscsi {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.594788 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.594963 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.595110 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.595275 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.595433 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.595697 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.595867 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.596131 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.596283 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.596429 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.596429 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.596743 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.596743 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.597061 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.597323 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.597475 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.597642 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.597811 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.597964 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.598237 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.598484 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.598642 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.598786 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.599138 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.599315 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.599461 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.599461 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.599841 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.600001 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.600403 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.600571 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.600836 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.601203 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.601360 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.601643 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.601787 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.601787 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.602174 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-768458-13-iscsi {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.602174 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.602589 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.602844 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.602992 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.603132 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.603344 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.603344 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.603642 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.603783 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.603783 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.603783 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.604507 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.604507 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.604911 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.605169 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.605319 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.605473 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.605626 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.605776 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.606042 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.606184 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.606361 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.606603 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.607011 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.607212 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.607790 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.608666 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.608938 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.609422 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.609564 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.609738 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.609872 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.610084 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.610231 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.610557 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.610720 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.610938 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.610938 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.611529 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.611657 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.611780 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.611947 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.611947 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.612328 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.612463 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.612699 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.612854 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.612854 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.612854 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.613286 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.613431 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.613592 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.613732 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.613732 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.613732 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.614122 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.614351 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.614351 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.614652 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.614779 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.614930 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.615150 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.615150 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.615597 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.615744 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.615744 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.616301 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.616501 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.616656 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.616781 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.616781 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.617023 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.617156 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.617288 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.617449 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.66 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.617449 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.66 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.617706 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.617831 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.617831 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.618082 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.618251 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.618251 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.618504 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.618638 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.618762 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.618762 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.619035 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.619035 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.619608 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.619838 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.619980 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.620115 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.620115 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.620384 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.620750 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.620750 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.620996 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.621129 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.621267 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.621611 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.621754 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.622335 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.623007 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.623160 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.623333 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.623333 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.623749 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.623949 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.624448 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.624764 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.624953 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.625107 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.625235 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.625439 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.625692 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.625884 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.626029 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.626175 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.626390 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.626608 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.626769 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.627000 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.627191 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.627492 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.627676 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.627814 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.627948 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.628072 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.628215 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.628501 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.628681 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.628830 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.628967 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.629170 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.629490 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.629736 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.629736 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.630002 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.630127 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.630298 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.630427 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.630666 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.630919 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.631062 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.631290 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.631438 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.631881 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.632012 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.632362 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.632531 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.632794 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.632939 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.633241 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.633475 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.633663 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.633792 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.634155 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.634647 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.634647 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.634976 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.635112 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.635315 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.635442 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.635578 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.635709 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.635887 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.636113 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.636263 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.636469 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.636629 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.636778 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.637048 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.637186 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.637379 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.637550 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.637678 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.637976 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.638113 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.638296 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.638467 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.638602 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.638899 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.639026 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.639214 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.639434 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.639575 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.639852 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 22 12:18:29.639991 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.640185 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.640382 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.640518 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.640822 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.640966 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.641152 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.641305 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.641535 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.641801 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.642043 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.642177 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.642309 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.642463 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.642663 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.642790 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.643034 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.643176 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.643416 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.643562 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.643695 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.643965 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.644102 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.644287 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.644464 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.644639 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.644909 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.645045 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.645227 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.645544 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.645700 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.645864 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.646022 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.646233 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.646377 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.646525 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.646674 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.646814 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.646960 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.647106 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.647397 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.647550 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.647802 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.648126 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.648126 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.648422 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.648586 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.648736 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.648886 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.649025 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.649163 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.649307 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.649462 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.649611 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.649770 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.650075 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.650220 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.650358 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.650516 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.650670 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.650836 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.651056 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.651200 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.651379 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.651549 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.651823 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.652529 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.652824 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.652989 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.653139 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.653287 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.653464 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.653701 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.653855 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.653994 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.654132 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.654280 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.654420 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.654557 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.654710 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.654858 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.655027 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.655307 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.655455 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.655609 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.655748 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.655894 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.656034 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.656182 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.656329 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.656484 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.656625 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.656763 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.656901 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.657049 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.657196 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.657342 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.657491 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.657636 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.657783 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.657931 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.658070 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.658208 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.658346 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.658483 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.658677 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.658818 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.658962 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.659102 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.659292 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.659450 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.663034 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.663034 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.664004 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.664221 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.664437 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.664640 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.664851 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.665046 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.665276 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.665617 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.665776 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.665942 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.666091 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.666231 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.666378 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.666532 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.666689 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.666841 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.666988 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.667127 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.667308 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.667455 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.667595 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.667743 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.667942 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.668082 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.668220 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.668220 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.668497 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.668646 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.668786 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.668932 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.669071 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.669221 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.669369 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.669508 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.669654 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.669802 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.669939 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.670086 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.670309 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.670460 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.670654 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.670804 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.670943 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.671096 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.671253 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.671398 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.671537 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.671699 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.671854 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.672002 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.672141 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.672970 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.673128 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.673326 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.673496 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.673741 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.673886 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.674143 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.674287 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.674443 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.674607 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.674763 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.674912 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.675052 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.675190 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.675382 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.675550 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.675792 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.675936 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.676074 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.676223 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.676361 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.676508 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.676658 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.676804 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.676944 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.677161 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.677310 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.677450 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.677588 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.677725 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.677862 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.678015 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.678163 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.678309 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.678577 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.678753 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.678902 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.679053 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.679201 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.679397 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.679550 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.679698 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.679846 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.679996 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.680144 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.680292 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.680431 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.680586 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.680741 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.680881 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.681028 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.681168 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.681306 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.681444 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.681591 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.681738 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.681885 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.682032 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.682181 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.682320 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.682783 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.683275 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.683426 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.683565 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.683734 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.683968 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.684145 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.684381 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.684533 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.684674 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.684811 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.684966 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.685114 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.685265 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.685404 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.685542 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.685679 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.685679 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.686079 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.686226 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.686367 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.686512 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.686661 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.686873 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.687013 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.687151 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.687338 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.687500 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.687641 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.687788 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.687927 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.688065 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.688210 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.688357 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.688506 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.688645 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.688831 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.688976 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.689115 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.689272 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.689426 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.689568 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.689713 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.690050 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.690220 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.690979 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.691141 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.691432 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.691580 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.691728 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.691884 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.692039 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.692193 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.692341 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.692480 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.692874 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.693046 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.693388 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.693535 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.693676 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.693823 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.694428 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.694688 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.694847 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.695000 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.695147 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.695317 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.695462 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.695612 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.695767 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.695933 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.696163 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.696307 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.696454 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.696601 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.696755 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.696897 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.697054 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.697202 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.697348 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.697500 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.697641 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.697786 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.697927 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.698065 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.698202 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.698355 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.698503 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.698648 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.698787 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.698936 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.699074 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.699285 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.699445 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.699586 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.699724 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.699868 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.700008 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.700156 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.700295 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.700432 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.700571 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.700716 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.700865 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.701023 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.701168 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.701306 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.701443 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.701580 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.701726 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.701873 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.702019 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.702158 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.702303 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.702450 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.702612 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.702612 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.702612 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.702612 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.703562 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.703706 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.703854 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.703993 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.704131 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.704298 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.704604 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.704839 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.704993 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.705146 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.705295 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.705445 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.705584 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.705882 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.706025 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.706180 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.706399 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.706543 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.706680 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.706828 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.706976 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.707116 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.707296 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.707443 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.707592 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.707741 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.707741 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.708025 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.708173 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.708312 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.708459 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.708680 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.708831 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.708970 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.709126 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.709126 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.709411 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.709411 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.709734 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.709878 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.710024 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.710172 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.710320 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.710415 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.710500 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.710585 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.710666 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.710753 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.710848 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.710936 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.711013 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.711096 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.711185 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.711307 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.711404 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.711489 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.711489 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.711635 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.711722 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.711807 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.711884 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.711966 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.712049 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.712140 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.712210 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.712364 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.712445 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.712515 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.712591 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.712662 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.712744 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.712823 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.713147 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.713229 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.713310 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.713388 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.713467 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.713560 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.713643 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.713714 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.713792 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.713871 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.713941 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.714079 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.714159 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.714231 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.714309 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.714387 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.714464 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.714846 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.714938 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.714938 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.715091 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.715091 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.715091 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.715468 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.715468 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.715468 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.715468 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.715743 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.715820 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.715891 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.715959 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.716035 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.716106 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.716175 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.716243 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.716311 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.716400 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.716400 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.716550 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.716631 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.716708 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.716785 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.716862 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.716946 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.717092 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.717172 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.717242 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.717311 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.717393 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.717470 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.717547 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.717624 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.717700 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.717777 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.717861 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.717951 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.718029 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.718106 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.718106 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.718245 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.718324 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.718394 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.718463 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.718539 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.718608 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.718685 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.718766 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.718850 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.718928 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.719144 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.719304 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.719405 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.719479 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.719555 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.719632 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.719702 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.719770 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.719914 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.719988 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.720138 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.720260 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.720452 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.720573 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.720771 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.720878 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.721087 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.721202 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.721446 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.721548 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.721707 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.721808 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.722017 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.722104 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.722344 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.722433 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.722653 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.722746 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.722979 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.723296 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.723296 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.723456 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.723622 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.723751 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.723939 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.724086 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.724243 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.724398 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.724553 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.724742 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.725024 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.725182 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.725407 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.725557 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.725686 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.725818 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.726013 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.726337 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.726438 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.726646 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.726734 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.726972 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.727056 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.727700 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.727811 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.727811 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.727972 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.728055 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.728137 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.728268 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.728359 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.728663 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.728755 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.728899 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.728986 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.729330 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.729424 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.729495 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.729572 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.729843 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.729931 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.730148 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.730235 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.730462 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.730623 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.730771 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.730851 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.731083 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.731174 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.731479 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.731583 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.731738 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.731832 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.732028 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.732107 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.732335 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.732414 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.732642 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.732720 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.732962 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.733042 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.733272 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.733385 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.733576 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.733675 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.733880 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.734064 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.734185 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.734315 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.734507 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.734629 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.734844 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.734978 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.735354 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.735434 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.735504 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.735601 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.735756 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.735916 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.736124 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.736246 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.736379 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.736574 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.736688 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.736907 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.736994 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.737224 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.737312 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.737554 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.737665 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.737876 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.737964 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.738191 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.738270 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.738501 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.738582 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.738812 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.738987 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.739124 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.739205 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.739470 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.739561 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.739774 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.739868 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.740084 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.740164 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.740392 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.740472 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.740697 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.740791 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.741084 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.741171 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.741672 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.741938 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.742038 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.742253 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.742335 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.742573 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.742663 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.742886 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.743014 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.743203 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.743763 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.743850 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.743933 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.744013 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.744099 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.744273 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.744362 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.744588 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.744675 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.744968 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.745070 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.745401 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.745493 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.745565 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.745645 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.745825 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.745916 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.746144 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.746453 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.746550 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.746781 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.746870 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.747109 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.747189 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.747549 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.747633 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.747766 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.747859 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.748118 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.748196 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.748422 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.748502 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.748733 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.748813 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.749059 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.749146 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.749363 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.749475 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.749669 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.749768 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.749973 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.750053 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.750290 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.750367 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.750597 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.750683 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.750918 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.751004 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.751264 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.751584 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.751744 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.751820 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.751908 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.751991 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.752187 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.752352 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.752514 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.752665 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.752853 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.752977 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.753180 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.753298 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.753501 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.753661 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.753830 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.753940 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.754245 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.754708 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.754861 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.755019 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.755269 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.755617 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.755792 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.755935 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.756074 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.756218 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.756384 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.756706 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.756863 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.757010 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.757159 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.757299 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.757444 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.757593 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.757593 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.757887 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.758026 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.758164 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.758301 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.758447 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.758601 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.758742 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.758880 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.759025 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.759201 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.759415 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.759567 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.759567 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.759928 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.760071 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.760218 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.760372 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.760519 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.760692 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.760841 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.761006 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.761161 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.761311 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.761458 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.761612 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.761751 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.761928 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.762073 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.762244 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.762473 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.762625 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.762765 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.762905 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.763053 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.763201 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.763377 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.763527 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.763708 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.763936 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.764161 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.764314 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.764460 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.764614 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.764754 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.764892 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.765046 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.765195 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.765437 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.765609 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.765945 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.766103 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.766253 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.766394 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.766541 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.766700 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.766914 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.767068 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.767323 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.768145 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.768308 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.768458 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.768618 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.768765 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.768912 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.769052 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.769431 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.769588 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.769748 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.769912 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.770185 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.770345 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.770487 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.770626 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.770783 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.770922 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.771060 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.771209 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.771377 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.771527 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.771668 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.771830 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.771991 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.772189 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.772339 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.772496 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.772722 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.772886 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.773037 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.773178 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.773317 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.773456 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.773594 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.773734 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.773881 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.773881 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.774347 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.774508 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.774661 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.774810 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.774971 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.775112 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.775300 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.775475 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.775712 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.775712 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.776831 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.778666 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.778830 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.778982 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.779124 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.779547 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.779547 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.779849 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.779999 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.780171 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.780406 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.780605 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.780979 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.781086 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.781179 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.781273 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.781365 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.781460 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.781544 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.781626 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.781707 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.781796 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.781879 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.781971 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.782068 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.782153 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.782246 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.782338 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.782431 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.782515 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.782604 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.782723 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.782805 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.782890 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.782981 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.783077 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.783160 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.783257 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.783342 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.783419 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.783503 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.783584 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.783656 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.783735 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.783814 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.783885 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.783964 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.784043 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.784132 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.784205 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.784283 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.784545 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.784636 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.784731 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.784731 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.784900 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.784991 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.785142 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.785232 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.785314 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.785403 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.785493 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.785493 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.785662 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.785762 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.785842 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.785926 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.786014 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.786300 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.786413 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.786494 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.786567 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.786645 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.786645 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.787088 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.787178 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.787307 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.787405 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.787490 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.787573 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.787669 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.787753 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.788078 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.788188 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.788548 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.788882 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.789004 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.789214 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.789312 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.789536 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.789682 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.789873 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.790004 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.790227 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.790404 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.790566 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.790729 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.790895 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.791051 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.791206 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.791396 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.791559 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.791745 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.791871 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.792012 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.792187 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.792330 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.792526 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.792637 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.792865 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.793015 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.793186 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.793280 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.793515 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.793614 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.793831 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.793929 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.794159 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.794248 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.794491 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.794609 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.794815 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.794924 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.795132 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.795222 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.795474 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.795566 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.795787 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.795880 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.796123 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.796319 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.796423 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.796635 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.796732 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.796974 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.797084 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.797300 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.797400 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.797625 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.797726 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.797935 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.798034 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.798254 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.798344 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.798579 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.798670 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.798884 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.798972 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.799190 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.799310 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.799531 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.799704 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.799869 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.800034 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.800170 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.800312 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.800473 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.800582 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.800753 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.800899 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.801044 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.801184 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.801319 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.801463 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.801629 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.801775 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.802009 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.802155 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.802330 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.802495 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.802639 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.802815 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.802959 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.803138 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.803477 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.803637 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.803755 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.804068 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.804387 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.804511 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.804730 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.804852 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.805058 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.805163 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.805374 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.805478 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.805685 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.805781 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.806006 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.806114 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.806312 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.806403 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.806558 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116272) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 22 12:18:29.806657 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.806912 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.807243 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.807567 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.807914 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.808186 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.808491 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.808819 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.809129 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.809434 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.809742 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.810054 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.810359 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.810701 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.810963 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.811367 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.811600 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.811903 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.812213 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.812517 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.812827 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.813131 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.813439 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.813740 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.814063 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.814368 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.814670 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.814991 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.815443 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.815771 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.816096 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.816408 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.816752 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.817071 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.817629 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.818013 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.818339 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.818685 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.819024 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.819790 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.820107 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.820420 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.820750 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.821062 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.821376 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.821690 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.822004 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.822317 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.822631 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.822942 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.823291 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.823584 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.823905 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.824244 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.825382 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.825382 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.825382 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.825596 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.825785 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.826095 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.826408 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.826717 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.827033 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.827388 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.827711 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.828022 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.828458 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.828775 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.829097 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.829425 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.829736 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.829925 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_db.sqlalchemy.engines [None req-e3a5b1fe-466e-43d7-acb7-3cec7e192df2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116272) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 22 12:18:29.830058 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.830382 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.830694 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.831023 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.831368 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.831683 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.832030 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.832360 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.832683 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.832989 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.833294 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.833601 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.833916 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.834244 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.834578 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.834929 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.835898 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.836226 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.836567 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.836888 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.837215 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.837542 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.837869 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.838186 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.838522 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.838835 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.839151 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.839491 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.839805 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.840117 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.840430 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.840759 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.841085 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.841394 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.841720 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.842038 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.842361 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.842682 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.842994 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.843349 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.843664 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.843980 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.844290 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.844601 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.844919 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.845238 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.845564 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.845965 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.846323 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.846545 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.846893 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.847209 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.847579 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.847907 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.848221 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.848535 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.848841 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 22 12:18:29.849084 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116273) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 22 12:18:29.873234 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_db.sqlalchemy.engines [None req-d4abbf43-31b8-4fdc-aac3-04d037f71eb1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116273) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 22 12:18:29.993048 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.context [None req-e3a5b1fe-466e-43d7-acb7-3cec7e192df2 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),68c9e085-8a03-42f8-94bd-bbf67f51e1ae(cell1) {{(pid=116272) load_cells /opt/stack/nova/nova/context.py:464}} Nov 22 12:18:29.997802 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-e3a5b1fe-466e-43d7-acb7-3cec7e192df2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:18:29.999446 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-e3a5b1fe-466e-43d7-acb7-3cec7e192df2 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:18:30.000299 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-e3a5b1fe-466e-43d7-acb7-3cec7e192df2 None None] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:18:30.002293 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-e3a5b1fe-466e-43d7-acb7-3cec7e192df2 None None] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:18:30.013688 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_db.sqlalchemy.engines [None req-e3a5b1fe-466e-43d7-acb7-3cec7e192df2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116272) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 22 12:18:30.015020 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_db.sqlalchemy.engines [None req-e3a5b1fe-466e-43d7-acb7-3cec7e192df2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116272) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 22 12:18:30.036010 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.context [None req-d4abbf43-31b8-4fdc-aac3-04d037f71eb1 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),68c9e085-8a03-42f8-94bd-bbf67f51e1ae(cell1) {{(pid=116273) load_cells /opt/stack/nova/nova/context.py:464}} Nov 22 12:18:30.040665 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-d4abbf43-31b8-4fdc-aac3-04d037f71eb1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:18:30.042261 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-d4abbf43-31b8-4fdc-aac3-04d037f71eb1 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:18:30.043063 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-d4abbf43-31b8-4fdc-aac3-04d037f71eb1 None None] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:18:30.045025 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-d4abbf43-31b8-4fdc-aac3-04d037f71eb1 None None] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:18:30.056506 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_db.sqlalchemy.engines [None req-d4abbf43-31b8-4fdc-aac3-04d037f71eb1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116273) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 22 12:18:30.057809 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_db.sqlalchemy.engines [None req-d4abbf43-31b8-4fdc-aac3-04d037f71eb1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116273) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 22 12:18:30.182983 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_db.sqlalchemy.engines [None req-e3a5b1fe-466e-43d7-acb7-3cec7e192df2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116272) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 22 12:18:30.223523 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_db.sqlalchemy.engines [None req-d4abbf43-31b8-4fdc-aac3-04d037f71eb1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116273) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 22 12:18:30.513739 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: WARNING keystonemiddleware.auth_token [None req-e3a5b1fe-466e-43d7-acb7-3cec7e192df2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 22 12:18:30.520615 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: WARNING keystonemiddleware.auth_token [None req-e3a5b1fe-466e-43d7-acb7-3cec7e192df2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 22 12:18:30.570692 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: WARNING keystonemiddleware.auth_token [None req-d4abbf43-31b8-4fdc-aac3-04d037f71eb1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 22 12:18:30.577433 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: WARNING keystonemiddleware.auth_token [None req-d4abbf43-31b8-4fdc-aac3-04d037f71eb1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 22 12:18:30.868170 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: WARNING keystonemiddleware.auth_token [None req-e3a5b1fe-466e-43d7-acb7-3cec7e192df2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 22 12:18:30.873702 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: WARNING keystonemiddleware.auth_token [None req-e3a5b1fe-466e-43d7-acb7-3cec7e192df2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 22 12:18:30.880153 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x563bd5a1a9c0 pid: 116272 (default app) Nov 22 12:18:30.940666 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: WARNING keystonemiddleware.auth_token [None req-d4abbf43-31b8-4fdc-aac3-04d037f71eb1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 22 12:18:30.948303 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: WARNING keystonemiddleware.auth_token [None req-d4abbf43-31b8-4fdc-aac3-04d037f71eb1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 22 12:18:30.953839 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x563bd5a1a9c0 pid: 116273 (default app) Nov 22 12:19:06.269348 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-37a2d78a-7526-45be-81d6-11410fc8a5aa tempest-VolumesNegativeTest-1944166946 tempest-VolumesNegativeTest-1944166946-project] Action: 'create', calling method: .version_select at 0x7fa1a92794c0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-344909801", "metadata": {"Type": "work"}}} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:19:06.272349 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-37a2d78a-7526-45be-81d6-11410fc8a5aa tempest-VolumesNegativeTest-1944166946 tempest-VolumesNegativeTest-1944166946-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=116272) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 12:19:06.274093 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-37a2d78a-7526-45be-81d6-11410fc8a5aa tempest-VolumesNegativeTest-1944166946 tempest-VolumesNegativeTest-1944166946-project] 10.222.0.66 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 2.044552 Nov 22 12:19:06.281109 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 1/1] 10.222.0.66 () {60 vars in 1155 bytes} [Mon Nov 22 12:19:04 2021] POST /compute/v2.1/os-volumes => generated 127 bytes in 2054 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Nov 22 12:19:06.585391 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-a72221a3-2c08-4664-bc29-c96595ce10e4 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1430527090", "imageRef": "31affc49-b6f0-44da-af65-4c65d72458b9", "flavorRef": "452", "networks": [{"uuid": "1a398bbd-8494-4c78-9a7f-9328646aea45"}]}} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:19:06.836244 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-0c3d399a-5d95-47af-a7c8-82a71f3bfb5d tempest-VolumesSnapshotsTestJSON-1609491625 tempest-VolumesSnapshotsTestJSON-1609491625-project] Action: 'create', calling method: .version_select at 0x7fa1a92784c0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1336500976"}} {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:19:07.513213 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.network.neutron [None req-a72221a3-2c08-4664-bc29-c96595ce10e4 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] validate_networks() for [('1a398bbd-8494-4c78-9a7f-9328646aea45', None, None, None, None, None)] {{(pid=116272) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 22 12:19:08.165036 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-0c3d399a-5d95-47af-a7c8-82a71f3bfb5d tempest-VolumesSnapshotsTestJSON-1609491625 tempest-VolumesSnapshotsTestJSON-1609491625-project] 10.222.0.66 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 2.993819 Nov 22 12:19:08.165908 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 1/2] 10.222.0.66 () {60 vars in 1154 bytes} [Mon Nov 22 12:19:05 2021] POST /compute/v2.1/os-volumes => generated 345 bytes in 2996 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Nov 22 12:19:08.180183 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-a9202e5b-6b9d-439f-962c-b664c3d90048 tempest-VolumesNegativeTest-1944166946 tempest-VolumesNegativeTest-1944166946-project] Action: 'create', calling method: .version_select at 0x7fa1a92060d0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-393510010", "metadata": {"Type": "work"}}} {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:19:08.181955 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-a9202e5b-6b9d-439f-962c-b664c3d90048 tempest-VolumesNegativeTest-1944166946 tempest-VolumesNegativeTest-1944166946-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=116273) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 12:19:08.183540 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-a9202e5b-6b9d-439f-962c-b664c3d90048 tempest-VolumesNegativeTest-1944166946 tempest-VolumesNegativeTest-1944166946-project] 10.222.0.66 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.015724 Nov 22 12:19:08.187531 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 2/3] 10.222.0.66 () {60 vars in 1155 bytes} [Mon Nov 22 12:19:08 2021] POST /compute/v2.1/os-volumes => generated 125 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 22 12:19:08.616437 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-ec3db97b-4d1c-4553-837e-44e5712e3e66 tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1384152944", "imageRef": "31affc49-b6f0-44da-af65-4c65d72458b9", "flavorRef": "452", "networks": [{"uuid": "b07068ae-2296-48cd-ab6a-7673ccc232c3"}]}} {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:19:08.627691 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.virt.hardware [None req-a72221a3-2c08-4664-bc29-c96595ce10e4 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Flavor limits 0:0:0 {{(pid=116272) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 22 12:19:08.628257 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.virt.hardware [None req-a72221a3-2c08-4664-bc29-c96595ce10e4 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Image limits 0:0:0 {{(pid=116272) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 22 12:19:08.628679 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.virt.hardware [None req-a72221a3-2c08-4664-bc29-c96595ce10e4 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Flavor pref 0:0:0 {{(pid=116272) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 22 12:19:08.629156 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.virt.hardware [None req-a72221a3-2c08-4664-bc29-c96595ce10e4 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Image pref 0:0:0 {{(pid=116272) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 22 12:19:08.629644 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.virt.hardware [None req-a72221a3-2c08-4664-bc29-c96595ce10e4 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116272) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 22 12:19:08.658037 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-a72221a3-2c08-4664-bc29-c96595ce10e4 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:08.658581 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-a72221a3-2c08-4664-bc29-c96595ce10e4 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:08.659514 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-a72221a3-2c08-4664-bc29-c96595ce10e4 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:08.671940 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-a72221a3-2c08-4664-bc29-c96595ce10e4 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:08.714118 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.quota [None req-a72221a3-2c08-4664-bc29-c96595ce10e4 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Getting quotas for project 5319fd2dee9b4b47b98f59bca1572ac8. Resources: {'ram', 'instances', 'cores'} {{(pid=116272) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 22 12:19:08.725956 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.quota [None req-a72221a3-2c08-4664-bc29-c96595ce10e4 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Getting quotas for user 8a4b581fa25045cea9585ae4e707585d and project 5319fd2dee9b4b47b98f59bca1572ac8. Resources: {'ram', 'instances', 'cores'} {{(pid=116272) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 22 12:19:08.771887 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-a72221a3-2c08-4664-bc29-c96595ce10e4 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Going to run 1 instances... {{(pid=116272) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 22 12:19:08.778217 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-a72221a3-2c08-4664-bc29-c96595ce10e4 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] [instance: 09a121f0-f7e5-4376-96bf-7008344dfe06] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='31affc49-b6f0-44da-af65-4c65d72458b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116272) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 22 12:19:08.808881 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.network.neutron [None req-ec3db97b-4d1c-4553-837e-44e5712e3e66 tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] validate_networks() for [('b07068ae-2296-48cd-ab6a-7673ccc232c3', None, None, None, None, None)] {{(pid=116273) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 22 12:19:08.972051 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-a72221a3-2c08-4664-bc29-c96595ce10e4 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.686844 Nov 22 12:19:08.980709 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 2/4] 10.222.0.66 () {60 vars in 1146 bytes} [Mon Nov 22 12:19:06 2021] POST /compute/v2.1/servers => generated 380 bytes in 2691 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 22 12:19:08.985691 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-c1077723-eec2-4714-9776-fc60f2414991 tempest-VolumesTestJSON-1448307877 tempest-VolumesTestJSON-1448307877-project] Calling method '.version_select at 0x7fa1a916f8b0>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:19:09.168519 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-c1077723-eec2-4714-9776-fc60f2414991 tempest-VolumesTestJSON-1448307877 tempest-VolumesTestJSON-1448307877-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/1d6526da-1444-451d-87ab-0c010e992caf" status: 200 len: 351 microversion: 2.1 time: 0.193894 Nov 22 12:19:09.169602 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 3/5] 10.222.0.66 () {58 vars in 1244 bytes} [Mon Nov 22 12:19:08 2021] GET /compute/v2.1/os-volumes/1d6526da-1444-451d-87ab-0c010e992caf => generated 351 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 12:19:09.193107 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-8d31b08b-4dc1-410d-8894-2502cb540cb4 tempest-VolumesSnapshotsTestJSON-1609491625 tempest-VolumesSnapshotsTestJSON-1609491625-project] Calling method '.version_select at 0x7fa1a8888b80>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:19:09.310339 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-8d31b08b-4dc1-410d-8894-2502cb540cb4 tempest-VolumesSnapshotsTestJSON-1609491625 tempest-VolumesSnapshotsTestJSON-1609491625-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/87aaa9f5-6fb1-42d2-9e4e-50ede7ab0610" status: 200 len: 346 microversion: 2.1 time: 0.139397 Nov 22 12:19:09.311471 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 4/6] 10.222.0.66 () {58 vars in 1244 bytes} [Mon Nov 22 12:19:09 2021] GET /compute/v2.1/os-volumes/87aaa9f5-6fb1-42d2-9e4e-50ede7ab0610 => generated 346 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 12:19:09.317156 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-95206ef3-5e3d-46f2-a349-0d8d1b8e011b tempest-VolumesNegativeTest-1944166946 tempest-VolumesNegativeTest-1944166946-project] Action: 'create', calling method: .version_select at 0x7fa1a3fc5310>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1123478353", "metadata": {"Type": "work"}}} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:19:09.318967 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-95206ef3-5e3d-46f2-a349-0d8d1b8e011b tempest-VolumesNegativeTest-1944166946 tempest-VolumesNegativeTest-1944166946-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=116272) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 12:19:09.327043 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-95206ef3-5e3d-46f2-a349-0d8d1b8e011b tempest-VolumesNegativeTest-1944166946 tempest-VolumesNegativeTest-1944166946-project] 10.222.0.66 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.009701 Nov 22 12:19:09.328433 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 5/7] 10.222.0.66 () {60 vars in 1155 bytes} [Mon Nov 22 12:19:09 2021] POST /compute/v2.1/os-volumes => generated 121 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 22 12:19:09.336037 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-7aceda76-1a42-47a0-8677-20c8bfbaf054 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:19:09.341135 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-7aceda76-1a42-47a0-8677-20c8bfbaf054 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] [instance: 09a121f0-f7e5-4376-96bf-7008344dfe06] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:19:09.553904 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-7aceda76-1a42-47a0-8677-20c8bfbaf054 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b581fa25045cea9585ae4e707585d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5319fd2dee9b4b47b98f59bca1572ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:19:09.588014 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-7aceda76-1a42-47a0-8677-20c8bfbaf054 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] 10.222.0.66 "GET /compute/v2.1/servers/09a121f0-f7e5-4376-96bf-7008344dfe06" status: 200 len: 1218 microversion: 2.1 time: 0.254330 Nov 22 12:19:09.589707 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 6/8] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:19:09 2021] GET /compute/v2.1/servers/09a121f0-f7e5-4376-96bf-7008344dfe06 => generated 1218 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:19:09.701871 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-7ed8f5d4-4add-4dc2-8905-2a2d2d2cd6bd tempest-VolumesSnapshotsTestJSON-1609491625 tempest-VolumesSnapshotsTestJSON-1609491625-project] Action: 'create', calling method: .version_select at 0x7fa1a3fdd790>, body: {"snapshot": {"volume_id": "87aaa9f5-6fb1-42d2-9e4e-50ede7ab0610", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-298526844"}} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:19:09.938484 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-7ed8f5d4-4add-4dc2-8905-2a2d2d2cd6bd tempest-VolumesSnapshotsTestJSON-1609491625 tempest-VolumesSnapshotsTestJSON-1609491625-project] 10.222.0.66 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.344749 Nov 22 12:19:09.944193 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 7/9] 10.222.0.66 () {60 vars in 1161 bytes} [Mon Nov 22 12:19:09 2021] POST /compute/v2.1/os-snapshots => generated 286 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 12:19:09.949642 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-372a519e-0f46-400a-9702-856f20cd4ab1 tempest-VolumesNegativeTest-1944166946 tempest-VolumesNegativeTest-1944166946-project] Calling method '.version_select at 0x7fa1a3fec670>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:19:10.015759 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.wsgi [None req-372a519e-0f46-400a-9702-856f20cd4ab1 tempest-VolumesNegativeTest-1944166946 tempest-VolumesNegativeTest-1944166946-project] HTTP exception thrown: Volume tempest-invalid-938016283 could not be found. Nov 22 12:19:10.016470 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-372a519e-0f46-400a-9702-856f20cd4ab1 tempest-VolumesNegativeTest-1944166946 tempest-VolumesNegativeTest-1944166946-project] Returning 404 to user: Volume tempest-invalid-938016283 could not be found. {{(pid=116272) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 12:19:10.018666 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-372a519e-0f46-400a-9702-856f20cd4ab1 tempest-VolumesNegativeTest-1944166946 tempest-VolumesNegativeTest-1944166946-project] 10.222.0.66 "DELETE /compute/v2.1/os-volumes/tempest-invalid-938016283" status: 404 len: 98 microversion: 2.1 time: 0.072792 Nov 22 12:19:10.019417 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 8/10] 10.222.0.66 () {58 vars in 1214 bytes} [Mon Nov 22 12:19:09 2021] DELETE /compute/v2.1/os-volumes/tempest-invalid-938016283 => generated 98 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 22 12:19:10.028272 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-b67b831f-460c-4855-8a55-222ae35b9911 tempest-VolumesSnapshotsTestJSON-1609491625 tempest-VolumesSnapshotsTestJSON-1609491625-project] Calling method '.version_select at 0x7fa1a3fc5940>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:19:10.198062 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-b67b831f-460c-4855-8a55-222ae35b9911 tempest-VolumesSnapshotsTestJSON-1609491625 tempest-VolumesSnapshotsTestJSON-1609491625-project] 10.222.0.66 "GET /compute/v2.1/os-snapshots/cff4f729-6c06-4d79-a654-abd4affcfc46" status: 200 len: 286 microversion: 2.1 time: 0.177357 Nov 22 12:19:10.198646 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 9/11] 10.222.0.66 () {58 vars in 1250 bytes} [Mon Nov 22 12:19:10 2021] GET /compute/v2.1/os-snapshots/cff4f729-6c06-4d79-a654-abd4affcfc46 => generated 286 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 12:19:10.209498 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-116d6dd5-a3e2-47e2-904b-087b6248c320 tempest-VolumesNegativeTest-1944166946 tempest-VolumesNegativeTest-1944166946-project] 10.222.0.66 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003701 Nov 22 12:19:10.210659 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 10/12] 10.222.0.66 () {58 vars in 1139 bytes} [Mon Nov 22 12:19:10 2021] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Nov 22 12:19:10.215944 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-97ec1070-e1ca-4896-8a47-f80324c501bc tempest-VolumesSnapshotsTestJSON-1609491625 tempest-VolumesSnapshotsTestJSON-1609491625-project] Calling method '.version_select at 0x7fa1a3fec280>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:19:10.223386 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.virt.hardware [None req-ec3db97b-4d1c-4553-837e-44e5712e3e66 tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Flavor limits 0:0:0 {{(pid=116273) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 22 12:19:10.223958 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.virt.hardware [None req-ec3db97b-4d1c-4553-837e-44e5712e3e66 tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Image limits 0:0:0 {{(pid=116273) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 22 12:19:10.224430 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.virt.hardware [None req-ec3db97b-4d1c-4553-837e-44e5712e3e66 tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Flavor pref 0:0:0 {{(pid=116273) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 22 12:19:10.224915 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.virt.hardware [None req-ec3db97b-4d1c-4553-837e-44e5712e3e66 tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Image pref 0:0:0 {{(pid=116273) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 22 12:19:10.225590 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.virt.hardware [None req-ec3db97b-4d1c-4553-837e-44e5712e3e66 tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116273) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 22 12:19:10.260995 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-ec3db97b-4d1c-4553-837e-44e5712e3e66 tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:10.260995 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-ec3db97b-4d1c-4553-837e-44e5712e3e66 tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:10.262156 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-ec3db97b-4d1c-4553-837e-44e5712e3e66 tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:10.262156 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-ec3db97b-4d1c-4553-837e-44e5712e3e66 tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:10.277589 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-97ec1070-e1ca-4896-8a47-f80324c501bc tempest-VolumesSnapshotsTestJSON-1609491625 tempest-VolumesSnapshotsTestJSON-1609491625-project] 10.222.0.66 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.065646 Nov 22 12:19:10.278160 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 11/13] 10.222.0.66 () {58 vars in 1139 bytes} [Mon Nov 22 12:19:10 2021] GET /compute/v2.1/os-snapshots => generated 289 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 12:19:10.283773 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-6e449064-b700-47a8-a151-b15abcf478b6 tempest-VolumesNegativeTest-1944166946 tempest-VolumesNegativeTest-1944166946-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003949 Nov 22 12:19:10.288829 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 12/14] 10.222.0.66 () {58 vars in 1136 bytes} [Mon Nov 22 12:19:10 2021] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 10 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Nov 22 12:19:10.294405 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-85c25a3c-a880-45e7-92bb-86ad042d3fc5 tempest-VolumesSnapshotsTestJSON-1609491625 tempest-VolumesSnapshotsTestJSON-1609491625-project] Calling method '.version_select at 0x7fa1a3fecd30>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:19:10.371213 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-85c25a3c-a880-45e7-92bb-86ad042d3fc5 tempest-VolumesSnapshotsTestJSON-1609491625 tempest-VolumesSnapshotsTestJSON-1609491625-project] 10.222.0.66 "GET /compute/v2.1/os-snapshots/cff4f729-6c06-4d79-a654-abd4affcfc46" status: 200 len: 286 microversion: 2.1 time: 0.080845 Nov 22 12:19:10.371911 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 13/15] 10.222.0.66 () {58 vars in 1250 bytes} [Mon Nov 22 12:19:10 2021] GET /compute/v2.1/os-snapshots/cff4f729-6c06-4d79-a654-abd4affcfc46 => generated 286 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 12:19:10.379471 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-103b3344-57d5-4341-a1db-3ea9482355d1 tempest-VolumesNegativeTest-1944166946 tempest-VolumesNegativeTest-1944166946-project] Calling method '.version_select at 0x7fa1a3fc5b80>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:19:10.390709 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.quota [None req-ec3db97b-4d1c-4553-837e-44e5712e3e66 tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Getting quotas for project 95c32f9960704ce6b26019efdc2abddc. Resources: {'ram', 'instances', 'cores'} {{(pid=116273) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 22 12:19:10.418946 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.quota [None req-ec3db97b-4d1c-4553-837e-44e5712e3e66 tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Getting quotas for user b3127e81d7664dbbbce53d6d7f2bae4c and project 95c32f9960704ce6b26019efdc2abddc. Resources: {'ram', 'instances', 'cores'} {{(pid=116273) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 22 12:19:10.427212 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.wsgi [None req-103b3344-57d5-4341-a1db-3ea9482355d1 tempest-VolumesNegativeTest-1944166946 tempest-VolumesNegativeTest-1944166946-project] HTTP exception thrown: Volume 757ed922-1791-4f20-b0f7-5f20e36c8957 could not be found. Nov 22 12:19:10.430308 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-103b3344-57d5-4341-a1db-3ea9482355d1 tempest-VolumesNegativeTest-1944166946 tempest-VolumesNegativeTest-1944166946-project] Returning 404 to user: Volume 757ed922-1791-4f20-b0f7-5f20e36c8957 could not be found. {{(pid=116272) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 12:19:10.431833 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-103b3344-57d5-4341-a1db-3ea9482355d1 tempest-VolumesNegativeTest-1944166946 tempest-VolumesNegativeTest-1944166946-project] 10.222.0.66 "DELETE /compute/v2.1/os-volumes/757ed922-1791-4f20-b0f7-5f20e36c8957" status: 404 len: 109 microversion: 2.1 time: 0.058704 Nov 22 12:19:10.432826 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 14/16] 10.222.0.66 () {58 vars in 1247 bytes} [Mon Nov 22 12:19:10 2021] DELETE /compute/v2.1/os-volumes/757ed922-1791-4f20-b0f7-5f20e36c8957 => generated 109 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 22 12:19:10.444773 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-ec3db97b-4d1c-4553-837e-44e5712e3e66 tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Going to run 1 instances... {{(pid=116273) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 22 12:19:10.448257 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-ec3db97b-4d1c-4553-837e-44e5712e3e66 tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] [instance: 0e1fe798-845f-4f01-b699-0e2fac35e5c3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='31affc49-b6f0-44da-af65-4c65d72458b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116273) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 22 12:19:10.465045 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-4a3f7d3c-10ee-47d2-87a0-2fd9a4442ba2 tempest-VolumesNegativeTest-1944166946 tempest-VolumesNegativeTest-1944166946-project] Calling method '.version_select at 0x7fa1a3fc5940>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:19:10.523489 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.wsgi [None req-4a3f7d3c-10ee-47d2-87a0-2fd9a4442ba2 tempest-VolumesNegativeTest-1944166946 tempest-VolumesNegativeTest-1944166946-project] HTTP exception thrown: Volume 8f8e3ef5-8051-4a4f-9353-c90250aff15a could not be found. Nov 22 12:19:10.524079 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-4a3f7d3c-10ee-47d2-87a0-2fd9a4442ba2 tempest-VolumesNegativeTest-1944166946 tempest-VolumesNegativeTest-1944166946-project] Returning 404 to user: Volume 8f8e3ef5-8051-4a4f-9353-c90250aff15a could not be found. {{(pid=116272) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 12:19:10.525067 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-4a3f7d3c-10ee-47d2-87a0-2fd9a4442ba2 tempest-VolumesNegativeTest-1944166946 tempest-VolumesNegativeTest-1944166946-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/8f8e3ef5-8051-4a4f-9353-c90250aff15a" status: 404 len: 109 microversion: 2.1 time: 0.086093 Nov 22 12:19:10.534790 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 15/17] 10.222.0.66 () {58 vars in 1244 bytes} [Mon Nov 22 12:19:10 2021] GET /compute/v2.1/os-volumes/8f8e3ef5-8051-4a4f-9353-c90250aff15a => generated 109 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 22 12:19:10.609107 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-e0c4cd1f-3b0c-4133-a7f3-e8eaa67e0d20 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:19:10.610181 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-e0c4cd1f-3b0c-4133-a7f3-e8eaa67e0d20 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] [instance: 09a121f0-f7e5-4376-96bf-7008344dfe06] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:19:10.687267 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-ec3db97b-4d1c-4553-837e-44e5712e3e66 tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.498227 Nov 22 12:19:10.688118 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 3/18] 10.222.0.66 () {60 vars in 1146 bytes} [Mon Nov 22 12:19:08 2021] POST /compute/v2.1/servers => generated 380 bytes in 2500 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 22 12:19:10.702913 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-614c7307-87b0-4c3f-8f0b-f2aaeb0fcc7b tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:19:10.703683 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-614c7307-87b0-4c3f-8f0b-f2aaeb0fcc7b tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] [instance: 0e1fe798-845f-4f01-b699-0e2fac35e5c3] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:19:10.858151 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-e0c4cd1f-3b0c-4133-a7f3-e8eaa67e0d20 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b581fa25045cea9585ae4e707585d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5319fd2dee9b4b47b98f59bca1572ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:19:10.873289 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-e0c4cd1f-3b0c-4133-a7f3-e8eaa67e0d20 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] 10.222.0.66 "GET /compute/v2.1/servers/09a121f0-f7e5-4376-96bf-7008344dfe06" status: 200 len: 1218 microversion: 2.1 time: 0.270905 Nov 22 12:19:10.874627 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 16/19] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:19:10 2021] GET /compute/v2.1/servers/09a121f0-f7e5-4376-96bf-7008344dfe06 => generated 1218 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 12:19:10.939717 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-614c7307-87b0-4c3f-8f0b-f2aaeb0fcc7b tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3127e81d7664dbbbce53d6d7f2bae4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c32f9960704ce6b26019efdc2abddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:19:10.961364 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-614c7307-87b0-4c3f-8f0b-f2aaeb0fcc7b tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] 10.222.0.66 "GET /compute/v2.1/servers/0e1fe798-845f-4f01-b699-0e2fac35e5c3" status: 200 len: 1215 microversion: 2.1 time: 0.262949 Nov 22 12:19:10.969403 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 4/20] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:19:10 2021] GET /compute/v2.1/servers/0e1fe798-845f-4f01-b699-0e2fac35e5c3 => generated 1215 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 12:19:11.391529 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-d85959db-d10a-4023-8fd3-52cd22704382 tempest-VolumesSnapshotsTestJSON-1609491625 tempest-VolumesSnapshotsTestJSON-1609491625-project] Calling method '.version_select at 0x7fa1a3fec790>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:19:11.507549 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-d85959db-d10a-4023-8fd3-52cd22704382 tempest-VolumesSnapshotsTestJSON-1609491625 tempest-VolumesSnapshotsTestJSON-1609491625-project] 10.222.0.66 "GET /compute/v2.1/os-snapshots/cff4f729-6c06-4d79-a654-abd4affcfc46" status: 200 len: 286 microversion: 2.1 time: 0.124378 Nov 22 12:19:11.508662 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 17/21] 10.222.0.66 () {58 vars in 1250 bytes} [Mon Nov 22 12:19:11 2021] GET /compute/v2.1/os-snapshots/cff4f729-6c06-4d79-a654-abd4affcfc46 => generated 286 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 12:19:11.902206 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-d4b0aba1-f277-4b61-b8ea-6a4a26d73ec9 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:19:11.903926 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-d4b0aba1-f277-4b61-b8ea-6a4a26d73ec9 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] [instance: 09a121f0-f7e5-4376-96bf-7008344dfe06] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:19:11.914496 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-d4b0aba1-f277-4b61-b8ea-6a4a26d73ec9 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:11.915730 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-d4b0aba1-f277-4b61-b8ea-6a4a26d73ec9 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:11.917049 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-d4b0aba1-f277-4b61-b8ea-6a4a26d73ec9 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:11.917675 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-d4b0aba1-f277-4b61-b8ea-6a4a26d73ec9 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:11.995119 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-a6d4f811-716f-42fc-9c1d-aedd22b48d85 tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:19:12.009898 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-a6d4f811-716f-42fc-9c1d-aedd22b48d85 tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] [instance: 0e1fe798-845f-4f01-b699-0e2fac35e5c3] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:19:12.201938 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-a6d4f811-716f-42fc-9c1d-aedd22b48d85 tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3127e81d7664dbbbce53d6d7f2bae4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c32f9960704ce6b26019efdc2abddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:19:12.225386 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-a6d4f811-716f-42fc-9c1d-aedd22b48d85 tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] 10.222.0.66 "GET /compute/v2.1/servers/0e1fe798-845f-4f01-b699-0e2fac35e5c3" status: 200 len: 1215 microversion: 2.1 time: 0.238304 Nov 22 12:19:12.229618 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 18/22] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:19:11 2021] GET /compute/v2.1/servers/0e1fe798-845f-4f01-b699-0e2fac35e5c3 => generated 1215 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:19:12.359496 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-d4b0aba1-f277-4b61-b8ea-6a4a26d73ec9 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b581fa25045cea9585ae4e707585d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5319fd2dee9b4b47b98f59bca1572ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:19:12.375160 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-d4b0aba1-f277-4b61-b8ea-6a4a26d73ec9 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] 10.222.0.66 "GET /compute/v2.1/servers/09a121f0-f7e5-4376-96bf-7008344dfe06" status: 200 len: 1222 microversion: 2.1 time: 0.478418 Nov 22 12:19:12.378000 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 5/23] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:19:11 2021] GET /compute/v2.1/servers/09a121f0-f7e5-4376-96bf-7008344dfe06 => generated 1222 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:19:12.519672 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-a89ae187-d7a9-4883-a990-14e4f745cf38 tempest-VolumesSnapshotsTestJSON-1609491625 tempest-VolumesSnapshotsTestJSON-1609491625-project] Calling method '.version_select at 0x7fa1a9279ca0>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:19:12.556364 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-a89ae187-d7a9-4883-a990-14e4f745cf38 tempest-VolumesSnapshotsTestJSON-1609491625 tempest-VolumesSnapshotsTestJSON-1609491625-project] 10.222.0.66 "GET /compute/v2.1/os-snapshots/cff4f729-6c06-4d79-a654-abd4affcfc46" status: 200 len: 286 microversion: 2.1 time: 0.040286 Nov 22 12:19:12.557041 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 19/24] 10.222.0.66 () {58 vars in 1250 bytes} [Mon Nov 22 12:19:12 2021] GET /compute/v2.1/os-snapshots/cff4f729-6c06-4d79-a654-abd4affcfc46 => generated 286 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 12:19:13.256247 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-6416b9de-db34-4358-89e8-ee92e6742631 tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:19:13.256247 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-6416b9de-db34-4358-89e8-ee92e6742631 tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] [instance: 0e1fe798-845f-4f01-b699-0e2fac35e5c3] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:19:13.281623 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-6416b9de-db34-4358-89e8-ee92e6742631 tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:13.283623 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-6416b9de-db34-4358-89e8-ee92e6742631 tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:13.288146 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-6416b9de-db34-4358-89e8-ee92e6742631 tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:13.290989 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-6416b9de-db34-4358-89e8-ee92e6742631 tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:13.406911 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-f1f491f4-0219-4ecd-b880-a8ff4cc02514 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:19:13.408040 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-f1f491f4-0219-4ecd-b880-a8ff4cc02514 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] [instance: 09a121f0-f7e5-4376-96bf-7008344dfe06] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:19:13.440994 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-f1f491f4-0219-4ecd-b880-a8ff4cc02514 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:13.449366 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-f1f491f4-0219-4ecd-b880-a8ff4cc02514 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:13.450860 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-f1f491f4-0219-4ecd-b880-a8ff4cc02514 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:13.457648 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-f1f491f4-0219-4ecd-b880-a8ff4cc02514 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:13.666536 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-6416b9de-db34-4358-89e8-ee92e6742631 tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3127e81d7664dbbbce53d6d7f2bae4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c32f9960704ce6b26019efdc2abddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:19:13.712944 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-6416b9de-db34-4358-89e8-ee92e6742631 tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] 10.222.0.66 "GET /compute/v2.1/servers/0e1fe798-845f-4f01-b699-0e2fac35e5c3" status: 200 len: 1219 microversion: 2.1 time: 0.457502 Nov 22 12:19:13.717661 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 6/25] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:19:13 2021] GET /compute/v2.1/servers/0e1fe798-845f-4f01-b699-0e2fac35e5c3 => generated 1219 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:19:13.737391 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-7b7ebf49-f0e4-4dcd-a458-8db7fa728db4 tempest-VolumesSnapshotsTestJSON-1609491625 tempest-VolumesSnapshotsTestJSON-1609491625-project] Calling method '.version_select at 0x7fa1a3f67f70>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:19:13.881055 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-7b7ebf49-f0e4-4dcd-a458-8db7fa728db4 tempest-VolumesSnapshotsTestJSON-1609491625 tempest-VolumesSnapshotsTestJSON-1609491625-project] 10.222.0.66 "GET /compute/v2.1/os-snapshots/cff4f729-6c06-4d79-a654-abd4affcfc46" status: 200 len: 287 microversion: 2.1 time: 0.150971 Nov 22 12:19:13.885199 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 7/26] 10.222.0.66 () {58 vars in 1250 bytes} [Mon Nov 22 12:19:13 2021] GET /compute/v2.1/os-snapshots/cff4f729-6c06-4d79-a654-abd4affcfc46 => generated 287 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 12:19:13.887986 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-f1f491f4-0219-4ecd-b880-a8ff4cc02514 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b581fa25045cea9585ae4e707585d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5319fd2dee9b4b47b98f59bca1572ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:19:13.906581 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-f1f491f4-0219-4ecd-b880-a8ff4cc02514 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] 10.222.0.66 "GET /compute/v2.1/servers/09a121f0-f7e5-4376-96bf-7008344dfe06" status: 200 len: 1222 microversion: 2.1 time: 0.512151 Nov 22 12:19:13.908023 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-0fc1c33e-8d20-418c-95a3-7885bc42ba53 tempest-VolumesSnapshotsTestJSON-1609491625 tempest-VolumesSnapshotsTestJSON-1609491625-project] Calling method '.version_select at 0x7fa1a3f588b0>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:19:13.911067 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 20/27] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:19:13 2021] GET /compute/v2.1/servers/09a121f0-f7e5-4376-96bf-7008344dfe06 => generated 1222 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:19:14.129913 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-0fc1c33e-8d20-418c-95a3-7885bc42ba53 tempest-VolumesSnapshotsTestJSON-1609491625 tempest-VolumesSnapshotsTestJSON-1609491625-project] 10.222.0.66 "DELETE /compute/v2.1/os-snapshots/cff4f729-6c06-4d79-a654-abd4affcfc46" status: 202 len: 0 microversion: 2.1 time: 0.236067 Nov 22 12:19:14.130639 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 8/28] 10.222.0.66 () {58 vars in 1253 bytes} [Mon Nov 22 12:19:13 2021] DELETE /compute/v2.1/os-snapshots/cff4f729-6c06-4d79-a654-abd4affcfc46 => generated 0 bytes in 238 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 22 12:19:14.139197 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-9707a5c5-ec9c-4e55-8afe-a04a3b924c67 tempest-VolumesSnapshotsTestJSON-1609491625 tempest-VolumesSnapshotsTestJSON-1609491625-project] Calling method '.version_select at 0x7fa1a3f64d30>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:19:14.201115 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-9707a5c5-ec9c-4e55-8afe-a04a3b924c67 tempest-VolumesSnapshotsTestJSON-1609491625 tempest-VolumesSnapshotsTestJSON-1609491625-project] 10.222.0.66 "GET /compute/v2.1/os-snapshots/cff4f729-6c06-4d79-a654-abd4affcfc46" status: 200 len: 286 microversion: 2.1 time: 0.065643 Nov 22 12:19:14.202030 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 21/29] 10.222.0.66 () {58 vars in 1250 bytes} [Mon Nov 22 12:19:14 2021] GET /compute/v2.1/os-snapshots/cff4f729-6c06-4d79-a654-abd4affcfc46 => generated 286 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 12:19:14.547183 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-efb74c2d-4550-488d-8426-fd86e1234ed5 tempest-VolumesTestJSON-1448307877 tempest-VolumesTestJSON-1448307877-project] Calling method '.version_select at 0x7fa1a3f73430>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:19:14.636951 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-efb74c2d-4550-488d-8426-fd86e1234ed5 tempest-VolumesTestJSON-1448307877 tempest-VolumesTestJSON-1448307877-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/d5216ccf-fca3-4a21-9a03-79d91a7422c9" status: 200 len: 350 microversion: 2.1 time: 0.094059 Nov 22 12:19:14.643671 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 9/30] 10.222.0.66 () {58 vars in 1244 bytes} [Mon Nov 22 12:19:14 2021] GET /compute/v2.1/os-volumes/d5216ccf-fca3-4a21-9a03-79d91a7422c9 => generated 350 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 12:19:14.746285 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-1768653a-4105-4692-97fe-8050311c5269 tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:19:14.747129 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-1768653a-4105-4692-97fe-8050311c5269 tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] [instance: 0e1fe798-845f-4f01-b699-0e2fac35e5c3] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:19:14.766383 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-1768653a-4105-4692-97fe-8050311c5269 tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:14.767086 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-1768653a-4105-4692-97fe-8050311c5269 tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:14.770075 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-1768653a-4105-4692-97fe-8050311c5269 tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:14.772084 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-1768653a-4105-4692-97fe-8050311c5269 tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:14.935329 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-52b92bdc-65e9-47e3-823b-4ee49656b1db tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:19:14.936655 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-52b92bdc-65e9-47e3-823b-4ee49656b1db tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] [instance: 09a121f0-f7e5-4376-96bf-7008344dfe06] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:19:14.954685 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-52b92bdc-65e9-47e3-823b-4ee49656b1db tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:14.957671 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-52b92bdc-65e9-47e3-823b-4ee49656b1db tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:14.961490 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-52b92bdc-65e9-47e3-823b-4ee49656b1db tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:14.962185 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-52b92bdc-65e9-47e3-823b-4ee49656b1db tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:15.001563 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-1768653a-4105-4692-97fe-8050311c5269 tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3127e81d7664dbbbce53d6d7f2bae4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c32f9960704ce6b26019efdc2abddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:19:15.013990 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-1768653a-4105-4692-97fe-8050311c5269 tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] 10.222.0.66 "GET /compute/v2.1/servers/0e1fe798-845f-4f01-b699-0e2fac35e5c3" status: 200 len: 1211 microversion: 2.1 time: 0.275808 Nov 22 12:19:15.024690 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 22/31] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:19:14 2021] GET /compute/v2.1/servers/0e1fe798-845f-4f01-b699-0e2fac35e5c3 => generated 1211 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:19:15.214495 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-834c43b2-bd4a-4157-816c-9d64518a5a0d tempest-VolumesSnapshotsTestJSON-1609491625 tempest-VolumesSnapshotsTestJSON-1609491625-project] Calling method '.version_select at 0x7fa1a3f6c700>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:19:15.275602 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-52b92bdc-65e9-47e3-823b-4ee49656b1db tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b581fa25045cea9585ae4e707585d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5319fd2dee9b4b47b98f59bca1572ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:19:15.280287 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.wsgi [None req-834c43b2-bd4a-4157-816c-9d64518a5a0d tempest-VolumesSnapshotsTestJSON-1609491625 tempest-VolumesSnapshotsTestJSON-1609491625-project] HTTP exception thrown: Snapshot cff4f729-6c06-4d79-a654-abd4affcfc46 could not be found. Nov 22 12:19:15.282558 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-834c43b2-bd4a-4157-816c-9d64518a5a0d tempest-VolumesSnapshotsTestJSON-1609491625 tempest-VolumesSnapshotsTestJSON-1609491625-project] Returning 404 to user: Snapshot cff4f729-6c06-4d79-a654-abd4affcfc46 could not be found. {{(pid=116272) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 12:19:15.283938 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-834c43b2-bd4a-4157-816c-9d64518a5a0d tempest-VolumesSnapshotsTestJSON-1609491625 tempest-VolumesSnapshotsTestJSON-1609491625-project] 10.222.0.66 "GET /compute/v2.1/os-snapshots/cff4f729-6c06-4d79-a654-abd4affcfc46" status: 404 len: 111 microversion: 2.1 time: 0.073694 Nov 22 12:19:15.294574 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 23/32] 10.222.0.66 () {58 vars in 1250 bytes} [Mon Nov 22 12:19:15 2021] GET /compute/v2.1/os-snapshots/cff4f729-6c06-4d79-a654-abd4affcfc46 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 22 12:19:15.301841 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-da7908de-9c27-485e-b8f9-835da69a19b3 tempest-VolumesSnapshotsTestJSON-1609491625 tempest-VolumesSnapshotsTestJSON-1609491625-project] Calling method '.version_select at 0x7fa1a3f193a0>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:19:15.316384 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-52b92bdc-65e9-47e3-823b-4ee49656b1db tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] 10.222.0.66 "GET /compute/v2.1/servers/09a121f0-f7e5-4376-96bf-7008344dfe06" status: 200 len: 1214 microversion: 2.1 time: 0.386108 Nov 22 12:19:15.329562 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 10/33] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:19:14 2021] GET /compute/v2.1/servers/09a121f0-f7e5-4376-96bf-7008344dfe06 => generated 1214 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 12:19:15.455024 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-da7908de-9c27-485e-b8f9-835da69a19b3 tempest-VolumesSnapshotsTestJSON-1609491625 tempest-VolumesSnapshotsTestJSON-1609491625-project] 10.222.0.66 "DELETE /compute/v2.1/os-volumes/87aaa9f5-6fb1-42d2-9e4e-50ede7ab0610" status: 202 len: 0 microversion: 2.1 time: 0.158544 Nov 22 12:19:15.456238 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 24/34] 10.222.0.66 () {58 vars in 1247 bytes} [Mon Nov 22 12:19:15 2021] DELETE /compute/v2.1/os-volumes/87aaa9f5-6fb1-42d2-9e4e-50ede7ab0610 => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 22 12:19:15.466700 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-5fdf776a-c7a9-48b2-bc46-e8abc9196164 tempest-VolumesSnapshotsTestJSON-1609491625 tempest-VolumesSnapshotsTestJSON-1609491625-project] Calling method '.version_select at 0x7fa1a3f58c10>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:19:15.659199 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-5fdf776a-c7a9-48b2-bc46-e8abc9196164 tempest-VolumesSnapshotsTestJSON-1609491625 tempest-VolumesSnapshotsTestJSON-1609491625-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/87aaa9f5-6fb1-42d2-9e4e-50ede7ab0610" status: 200 len: 345 microversion: 2.1 time: 0.197703 Nov 22 12:19:15.660058 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 11/35] 10.222.0.66 () {58 vars in 1244 bytes} [Mon Nov 22 12:19:15 2021] GET /compute/v2.1/os-volumes/87aaa9f5-6fb1-42d2-9e4e-50ede7ab0610 => generated 345 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 12:19:16.043928 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-59b09144-0fa6-45a4-b729-02f308532c8f tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:19:16.047327 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-59b09144-0fa6-45a4-b729-02f308532c8f tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] [instance: 0e1fe798-845f-4f01-b699-0e2fac35e5c3] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:19:16.057831 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-59b09144-0fa6-45a4-b729-02f308532c8f tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:16.060693 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-59b09144-0fa6-45a4-b729-02f308532c8f tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:16.062300 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-59b09144-0fa6-45a4-b729-02f308532c8f tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:16.064009 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-59b09144-0fa6-45a4-b729-02f308532c8f tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:16.320420 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-92c1ae04-ad05-4301-bb13-b61c896abefe tempest-VolumesTestJSON-1448307877 tempest-VolumesTestJSON-1448307877-project] Calling method '.version_select at 0x7fa1a3f58a60>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:19:16.428418 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-59b09144-0fa6-45a4-b729-02f308532c8f tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3127e81d7664dbbbce53d6d7f2bae4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c32f9960704ce6b26019efdc2abddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:19:16.436971 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-92c1ae04-ad05-4301-bb13-b61c896abefe tempest-VolumesTestJSON-1448307877 tempest-VolumesTestJSON-1448307877-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/16ff1df4-6aef-4589-9050-f29b158ae11d" status: 200 len: 351 microversion: 2.1 time: 0.120198 Nov 22 12:19:16.437963 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 12/36] 10.222.0.66 () {58 vars in 1244 bytes} [Mon Nov 22 12:19:16 2021] GET /compute/v2.1/os-volumes/16ff1df4-6aef-4589-9050-f29b158ae11d => generated 351 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 12:19:16.442965 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-79f37e8f-71a8-4f46-801c-73fa1f111ef4 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:19:16.444393 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-79f37e8f-71a8-4f46-801c-73fa1f111ef4 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] [instance: 09a121f0-f7e5-4376-96bf-7008344dfe06] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:19:16.458465 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-59b09144-0fa6-45a4-b729-02f308532c8f tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] 10.222.0.66 "GET /compute/v2.1/servers/0e1fe798-845f-4f01-b699-0e2fac35e5c3" status: 200 len: 1267 microversion: 2.1 time: 0.419019 Nov 22 12:19:16.459094 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 25/37] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:19:16 2021] GET /compute/v2.1/servers/0e1fe798-845f-4f01-b699-0e2fac35e5c3 => generated 1267 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:19:16.493042 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-207ec8cf-8658-41f2-85e5-fa830cc63f55 tempest-VolumesTestJSON-1448307877 tempest-VolumesTestJSON-1448307877-project] Calling method '.version_select at 0x7fa1a3f7b1f0>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:19:16.493480 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-79f37e8f-71a8-4f46-801c-73fa1f111ef4 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:16.494514 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-79f37e8f-71a8-4f46-801c-73fa1f111ef4 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:16.495561 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-79f37e8f-71a8-4f46-801c-73fa1f111ef4 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:16.498839 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-79f37e8f-71a8-4f46-801c-73fa1f111ef4 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:16.792793 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-79f37e8f-71a8-4f46-801c-73fa1f111ef4 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b581fa25045cea9585ae4e707585d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5319fd2dee9b4b47b98f59bca1572ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:19:16.810531 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-79f37e8f-71a8-4f46-801c-73fa1f111ef4 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] 10.222.0.66 "GET /compute/v2.1/servers/09a121f0-f7e5-4376-96bf-7008344dfe06" status: 200 len: 1276 microversion: 2.1 time: 0.369452 Nov 22 12:19:16.811704 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 13/38] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:19:16 2021] GET /compute/v2.1/servers/09a121f0-f7e5-4376-96bf-7008344dfe06 => generated 1276 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:19:16.819505 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-207ec8cf-8658-41f2-85e5-fa830cc63f55 tempest-VolumesTestJSON-1448307877 tempest-VolumesTestJSON-1448307877-project] 10.222.0.66 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.352620 Nov 22 12:19:16.820284 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 26/39] 10.222.0.66 () {58 vars in 1133 bytes} [Mon Nov 22 12:19:16 2021] GET /compute/v2.1/os-volumes => generated 1035 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:19:16.832991 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-3f261241-0cbc-468a-8345-21cb45ce46bf tempest-VolumesSnapshotsTestJSON-1609491625 tempest-VolumesSnapshotsTestJSON-1609491625-project] Calling method '.version_select at 0x7fa1a3f678b0>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:19:16.855535 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-ef7dfd1b-7204-40bb-a36d-deea55483314 tempest-VolumesTestJSON-1448307877 tempest-VolumesTestJSON-1448307877-project] Calling method '.version_select at 0x7fa1a3f34b80>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:19:16.953742 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.wsgi [None req-3f261241-0cbc-468a-8345-21cb45ce46bf tempest-VolumesSnapshotsTestJSON-1609491625 tempest-VolumesSnapshotsTestJSON-1609491625-project] HTTP exception thrown: Volume 87aaa9f5-6fb1-42d2-9e4e-50ede7ab0610 could not be found. Nov 22 12:19:16.954338 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-3f261241-0cbc-468a-8345-21cb45ce46bf tempest-VolumesSnapshotsTestJSON-1609491625 tempest-VolumesSnapshotsTestJSON-1609491625-project] Returning 404 to user: Volume 87aaa9f5-6fb1-42d2-9e4e-50ede7ab0610 could not be found. {{(pid=116273) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 12:19:16.955202 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-3f261241-0cbc-468a-8345-21cb45ce46bf tempest-VolumesSnapshotsTestJSON-1609491625 tempest-VolumesSnapshotsTestJSON-1609491625-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/87aaa9f5-6fb1-42d2-9e4e-50ede7ab0610" status: 404 len: 109 microversion: 2.1 time: 0.141863 Nov 22 12:19:16.960215 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 14/40] 10.222.0.66 () {58 vars in 1244 bytes} [Mon Nov 22 12:19:16 2021] GET /compute/v2.1/os-volumes/87aaa9f5-6fb1-42d2-9e4e-50ede7ab0610 => generated 109 bytes in 147 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 22 12:19:16.972317 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-1f3bd59f-e951-4410-be69-bb5edf00689b tempest-VolumesSnapshotsTestJSON-1609491625 tempest-VolumesSnapshotsTestJSON-1609491625-project] Calling method '.version_select at 0x7fa1a9147940>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:19:17.039783 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.wsgi [None req-1f3bd59f-e951-4410-be69-bb5edf00689b tempest-VolumesSnapshotsTestJSON-1609491625 tempest-VolumesSnapshotsTestJSON-1609491625-project] HTTP exception thrown: Volume 87aaa9f5-6fb1-42d2-9e4e-50ede7ab0610 could not be found. Nov 22 12:19:17.041911 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-1f3bd59f-e951-4410-be69-bb5edf00689b tempest-VolumesSnapshotsTestJSON-1609491625 tempest-VolumesSnapshotsTestJSON-1609491625-project] Returning 404 to user: Volume 87aaa9f5-6fb1-42d2-9e4e-50ede7ab0610 could not be found. {{(pid=116273) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 12:19:17.042782 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-1f3bd59f-e951-4410-be69-bb5edf00689b tempest-VolumesSnapshotsTestJSON-1609491625 tempest-VolumesSnapshotsTestJSON-1609491625-project] 10.222.0.66 "DELETE /compute/v2.1/os-volumes/87aaa9f5-6fb1-42d2-9e4e-50ede7ab0610" status: 404 len: 109 microversion: 2.1 time: 0.075420 Nov 22 12:19:17.043813 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 15/41] 10.222.0.66 () {58 vars in 1247 bytes} [Mon Nov 22 12:19:16 2021] DELETE /compute/v2.1/os-volumes/87aaa9f5-6fb1-42d2-9e4e-50ede7ab0610 => generated 109 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 22 12:19:17.052874 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-65cdc28c-84e5-4076-8413-26bcee921078 tempest-VolumesSnapshotsTestJSON-1609491625 tempest-VolumesSnapshotsTestJSON-1609491625-project] Calling method '.version_select at 0x7fa1a3f674c0>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:19:17.075598 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-ef7dfd1b-7204-40bb-a36d-deea55483314 tempest-VolumesTestJSON-1448307877 tempest-VolumesTestJSON-1448307877-project] 10.222.0.66 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.225781 Nov 22 12:19:17.076577 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 27/42] 10.222.0.66 () {58 vars in 1148 bytes} [Mon Nov 22 12:19:16 2021] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 12:19:17.096359 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-765c6b2b-4bc3-4a45-8150-90665849600c tempest-VolumesTestJSON-1448307877 tempest-VolumesTestJSON-1448307877-project] Calling method '.version_select at 0x7fa1a3f34e50>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:19:17.142050 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.wsgi [None req-65cdc28c-84e5-4076-8413-26bcee921078 tempest-VolumesSnapshotsTestJSON-1609491625 tempest-VolumesSnapshotsTestJSON-1609491625-project] HTTP exception thrown: Volume 87aaa9f5-6fb1-42d2-9e4e-50ede7ab0610 could not be found. Nov 22 12:19:17.143030 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-65cdc28c-84e5-4076-8413-26bcee921078 tempest-VolumesSnapshotsTestJSON-1609491625 tempest-VolumesSnapshotsTestJSON-1609491625-project] Returning 404 to user: Volume 87aaa9f5-6fb1-42d2-9e4e-50ede7ab0610 could not be found. {{(pid=116273) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 12:19:17.144059 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-65cdc28c-84e5-4076-8413-26bcee921078 tempest-VolumesSnapshotsTestJSON-1609491625 tempest-VolumesSnapshotsTestJSON-1609491625-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/87aaa9f5-6fb1-42d2-9e4e-50ede7ab0610" status: 404 len: 109 microversion: 2.1 time: 0.096461 Nov 22 12:19:17.145110 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 16/43] 10.222.0.66 () {58 vars in 1244 bytes} [Mon Nov 22 12:19:17 2021] GET /compute/v2.1/os-volumes/87aaa9f5-6fb1-42d2-9e4e-50ede7ab0610 => generated 109 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 22 12:19:17.301676 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-765c6b2b-4bc3-4a45-8150-90665849600c tempest-VolumesTestJSON-1448307877 tempest-VolumesTestJSON-1448307877-project] 10.222.0.66 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.217174 Nov 22 12:19:17.302227 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 28/44] 10.222.0.66 () {58 vars in 1133 bytes} [Mon Nov 22 12:19:17 2021] GET /compute/v2.1/os-volumes => generated 1035 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 12:19:17.314460 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-082c734f-ffb5-4d0b-843b-0a43ba591b1c tempest-VolumesTestJSON-1448307877 tempest-VolumesTestJSON-1448307877-project] Calling method '.version_select at 0x7fa1a3f67ca0>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:19:17.475772 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-ae9b1070-5473-429c-84f0-ab45829caaa6 tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:19:17.476407 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-ae9b1070-5473-429c-84f0-ab45829caaa6 tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] [instance: 0e1fe798-845f-4f01-b699-0e2fac35e5c3] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:19:17.496991 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-ae9b1070-5473-429c-84f0-ab45829caaa6 tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:17.496991 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-ae9b1070-5473-429c-84f0-ab45829caaa6 tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:17.496991 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-ae9b1070-5473-429c-84f0-ab45829caaa6 tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:17.503872 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-ae9b1070-5473-429c-84f0-ab45829caaa6 tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:17.622725 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-082c734f-ffb5-4d0b-843b-0a43ba591b1c tempest-VolumesTestJSON-1448307877 tempest-VolumesTestJSON-1448307877-project] 10.222.0.66 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.312091 Nov 22 12:19:17.623609 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 17/45] 10.222.0.66 () {58 vars in 1166 bytes} [Mon Nov 22 12:19:17 2021] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 12:19:17.634932 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-7062a84e-8606-49c5-bdc0-029599f07257 tempest-VolumesTestJSON-1448307877 tempest-VolumesTestJSON-1448307877-project] Calling method '.version_select at 0x7fa1a3f32af0>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:19:17.841414 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-7062a84e-8606-49c5-bdc0-029599f07257 tempest-VolumesTestJSON-1448307877 tempest-VolumesTestJSON-1448307877-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.210190 Nov 22 12:19:17.850679 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 18/46] 10.222.0.66 () {58 vars in 1169 bytes} [Mon Nov 22 12:19:17 2021] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 12:19:17.856642 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-578c5385-8af8-456f-b13b-450b6b661c8e tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:19:17.862057 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-578c5385-8af8-456f-b13b-450b6b661c8e tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] [instance: 09a121f0-f7e5-4376-96bf-7008344dfe06] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:19:17.872177 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-ae9b1070-5473-429c-84f0-ab45829caaa6 tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3127e81d7664dbbbce53d6d7f2bae4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c32f9960704ce6b26019efdc2abddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:19:17.880373 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-578c5385-8af8-456f-b13b-450b6b661c8e tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:17.880624 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-578c5385-8af8-456f-b13b-450b6b661c8e tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:17.881450 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-578c5385-8af8-456f-b13b-450b6b661c8e tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:17.881887 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-578c5385-8af8-456f-b13b-450b6b661c8e tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:17.894264 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-ae9b1070-5473-429c-84f0-ab45829caaa6 tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] 10.222.0.66 "GET /compute/v2.1/servers/0e1fe798-845f-4f01-b699-0e2fac35e5c3" status: 200 len: 1273 microversion: 2.1 time: 0.422120 Nov 22 12:19:17.897144 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 29/47] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:19:17 2021] GET /compute/v2.1/servers/0e1fe798-845f-4f01-b699-0e2fac35e5c3 => generated 1273 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 12:19:17.914649 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-8c2ce5cb-098e-4999-a57c-df45ca9939ea tempest-VolumesTestJSON-1448307877 tempest-VolumesTestJSON-1448307877-project] Calling method '.version_select at 0x7fa1a3f34280>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:19:18.101032 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-578c5385-8af8-456f-b13b-450b6b661c8e tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b581fa25045cea9585ae4e707585d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5319fd2dee9b4b47b98f59bca1572ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:19:18.115323 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-578c5385-8af8-456f-b13b-450b6b661c8e tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] 10.222.0.66 "GET /compute/v2.1/servers/09a121f0-f7e5-4376-96bf-7008344dfe06" status: 200 len: 1276 microversion: 2.1 time: 0.262508 Nov 22 12:19:18.117553 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 19/48] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:19:17 2021] GET /compute/v2.1/servers/09a121f0-f7e5-4376-96bf-7008344dfe06 => generated 1276 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:19:18.119942 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-8c2ce5cb-098e-4999-a57c-df45ca9939ea tempest-VolumesTestJSON-1448307877 tempest-VolumesTestJSON-1448307877-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.221713 Nov 22 12:19:18.121333 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 30/49] 10.222.0.66 () {58 vars in 1154 bytes} [Mon Nov 22 12:19:17 2021] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:19:18.133184 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-865bc5fd-b441-4271-a134-6e52212ef81d tempest-VolumesTestJSON-1448307877 tempest-VolumesTestJSON-1448307877-project] Calling method '.version_select at 0x7fa1a3f67820>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:19:18.313905 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-865bc5fd-b441-4271-a134-6e52212ef81d tempest-VolumesTestJSON-1448307877 tempest-VolumesTestJSON-1448307877-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.184311 Nov 22 12:19:18.326914 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-d7d1c16d-3d22-408c-aaa6-b76c00b929fc tempest-VolumesTestJSON-1448307877 tempest-VolumesTestJSON-1448307877-project] Calling method '.version_select at 0x7fa1a3f6c3a0>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:19:18.327490 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 20/50] 10.222.0.66 () {58 vars in 1187 bytes} [Mon Nov 22 12:19:18 2021] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 12:19:18.518589 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-d7d1c16d-3d22-408c-aaa6-b76c00b929fc tempest-VolumesTestJSON-1448307877 tempest-VolumesTestJSON-1448307877-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.195660 Nov 22 12:19:18.519165 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 31/51] 10.222.0.66 () {58 vars in 1154 bytes} [Mon Nov 22 12:19:18 2021] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:19:18.926071 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-a87a9998-c506-4896-8c9b-246ddfb183b1 tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:19:18.926071 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-a87a9998-c506-4896-8c9b-246ddfb183b1 tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] [instance: 0e1fe798-845f-4f01-b699-0e2fac35e5c3] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:19:18.949928 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-a87a9998-c506-4896-8c9b-246ddfb183b1 tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:18.950390 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-a87a9998-c506-4896-8c9b-246ddfb183b1 tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:18.951416 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-a87a9998-c506-4896-8c9b-246ddfb183b1 tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:18.952011 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-a87a9998-c506-4896-8c9b-246ddfb183b1 tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:19.143545 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-a1e10a80-5cb1-4086-9a68-843d6064fabb tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:19:19.145005 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-a1e10a80-5cb1-4086-9a68-843d6064fabb tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] [instance: 09a121f0-f7e5-4376-96bf-7008344dfe06] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:19:19.157376 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-a1e10a80-5cb1-4086-9a68-843d6064fabb tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:19.164631 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-a1e10a80-5cb1-4086-9a68-843d6064fabb tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:19.166108 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-a1e10a80-5cb1-4086-9a68-843d6064fabb tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:19.166908 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-a1e10a80-5cb1-4086-9a68-843d6064fabb tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:19.177291 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-a87a9998-c506-4896-8c9b-246ddfb183b1 tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3127e81d7664dbbbce53d6d7f2bae4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c32f9960704ce6b26019efdc2abddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:19:19.188929 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-a87a9998-c506-4896-8c9b-246ddfb183b1 tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] 10.222.0.66 "GET /compute/v2.1/servers/0e1fe798-845f-4f01-b699-0e2fac35e5c3" status: 200 len: 1273 microversion: 2.1 time: 0.274451 Nov 22 12:19:19.192192 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 21/52] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:19:18 2021] GET /compute/v2.1/servers/0e1fe798-845f-4f01-b699-0e2fac35e5c3 => generated 1273 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:19:19.338626 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-a1e10a80-5cb1-4086-9a68-843d6064fabb tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b581fa25045cea9585ae4e707585d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5319fd2dee9b4b47b98f59bca1572ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:19:19.347753 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-a1e10a80-5cb1-4086-9a68-843d6064fabb tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] 10.222.0.66 "GET /compute/v2.1/servers/09a121f0-f7e5-4376-96bf-7008344dfe06" status: 200 len: 1276 microversion: 2.1 time: 0.209461 Nov 22 12:19:19.350187 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 32/53] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:19:19 2021] GET /compute/v2.1/servers/09a121f0-f7e5-4376-96bf-7008344dfe06 => generated 1276 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 12:19:20.209107 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-c221cc41-d7a7-4b15-9bdc-f3bd88cdcd5f tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:19:20.209904 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-c221cc41-d7a7-4b15-9bdc-f3bd88cdcd5f tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] [instance: 0e1fe798-845f-4f01-b699-0e2fac35e5c3] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:19:20.220563 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-c221cc41-d7a7-4b15-9bdc-f3bd88cdcd5f tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:20.221373 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-c221cc41-d7a7-4b15-9bdc-f3bd88cdcd5f tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:20.222458 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-c221cc41-d7a7-4b15-9bdc-f3bd88cdcd5f tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:20.223297 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-c221cc41-d7a7-4b15-9bdc-f3bd88cdcd5f tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:20.384380 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-c221cc41-d7a7-4b15-9bdc-f3bd88cdcd5f tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3127e81d7664dbbbce53d6d7f2bae4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c32f9960704ce6b26019efdc2abddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:19:20.396288 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-c221cc41-d7a7-4b15-9bdc-f3bd88cdcd5f tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] 10.222.0.66 "GET /compute/v2.1/servers/0e1fe798-845f-4f01-b699-0e2fac35e5c3" status: 200 len: 1273 microversion: 2.1 time: 0.189967 Nov 22 12:19:20.397807 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 33/54] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:19:20 2021] GET /compute/v2.1/servers/0e1fe798-845f-4f01-b699-0e2fac35e5c3 => generated 1273 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 12:19:20.398275 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-92f076d3-37ca-487a-91d5-1e5171c5d801 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1020475739", "imageRef": "31affc49-b6f0-44da-af65-4c65d72458b9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "08903c03-f7d7-43c9-ab4d-565ac4637d53"}]}} {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:19:20.411977 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-ee89b74a-78db-41be-9bf5-f2877a5ef87b tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:19:20.415298 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-ee89b74a-78db-41be-9bf5-f2877a5ef87b tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] [instance: 09a121f0-f7e5-4376-96bf-7008344dfe06] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:19:20.424999 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-ee89b74a-78db-41be-9bf5-f2877a5ef87b tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:20.426213 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-ee89b74a-78db-41be-9bf5-f2877a5ef87b tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:20.427209 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-ee89b74a-78db-41be-9bf5-f2877a5ef87b tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:20.427934 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-ee89b74a-78db-41be-9bf5-f2877a5ef87b tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:20.523525 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.network.neutron [None req-92f076d3-37ca-487a-91d5-1e5171c5d801 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] validate_networks() for [('08903c03-f7d7-43c9-ab4d-565ac4637d53', None, None, None, None, None)] {{(pid=116273) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 22 12:19:21.402306 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-ee89b74a-78db-41be-9bf5-f2877a5ef87b tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b581fa25045cea9585ae4e707585d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5319fd2dee9b4b47b98f59bca1572ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:19:21.415962 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-ee89b74a-78db-41be-9bf5-f2877a5ef87b tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] 10.222.0.66 "GET /compute/v2.1/servers/09a121f0-f7e5-4376-96bf-7008344dfe06" status: 200 len: 1318 microversion: 2.1 time: 1.010164 Nov 22 12:19:21.425654 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 34/55] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:19:20 2021] GET /compute/v2.1/servers/09a121f0-f7e5-4376-96bf-7008344dfe06 => generated 1318 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:19:21.433358 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-decdbf59-64d1-42b4-91b7-d354fdad2e17 tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:19:21.443480 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-decdbf59-64d1-42b4-91b7-d354fdad2e17 tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] [instance: 0e1fe798-845f-4f01-b699-0e2fac35e5c3] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:19:21.456558 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-decdbf59-64d1-42b4-91b7-d354fdad2e17 tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:21.459930 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-decdbf59-64d1-42b4-91b7-d354fdad2e17 tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:21.461144 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-decdbf59-64d1-42b4-91b7-d354fdad2e17 tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:21.461803 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-decdbf59-64d1-42b4-91b7-d354fdad2e17 tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:21.708472 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-decdbf59-64d1-42b4-91b7-d354fdad2e17 tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3127e81d7664dbbbce53d6d7f2bae4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c32f9960704ce6b26019efdc2abddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:19:21.719262 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-decdbf59-64d1-42b4-91b7-d354fdad2e17 tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] 10.222.0.66 "GET /compute/v2.1/servers/0e1fe798-845f-4f01-b699-0e2fac35e5c3" status: 200 len: 1273 microversion: 2.1 time: 0.290675 Nov 22 12:19:21.722155 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 35/56] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:19:21 2021] GET /compute/v2.1/servers/0e1fe798-845f-4f01-b699-0e2fac35e5c3 => generated 1273 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:19:22.016346 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.virt.hardware [None req-92f076d3-37ca-487a-91d5-1e5171c5d801 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Flavor limits 0:0:0 {{(pid=116273) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 22 12:19:22.016937 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.virt.hardware [None req-92f076d3-37ca-487a-91d5-1e5171c5d801 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Image limits 0:0:0 {{(pid=116273) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 22 12:19:22.017389 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.virt.hardware [None req-92f076d3-37ca-487a-91d5-1e5171c5d801 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Flavor pref 0:0:0 {{(pid=116273) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 22 12:19:22.018187 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.virt.hardware [None req-92f076d3-37ca-487a-91d5-1e5171c5d801 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Image pref 0:0:0 {{(pid=116273) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 22 12:19:22.018756 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.virt.hardware [None req-92f076d3-37ca-487a-91d5-1e5171c5d801 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116273) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 22 12:19:22.039868 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-92f076d3-37ca-487a-91d5-1e5171c5d801 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:22.040593 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-92f076d3-37ca-487a-91d5-1e5171c5d801 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:22.041717 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-92f076d3-37ca-487a-91d5-1e5171c5d801 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:22.043356 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-92f076d3-37ca-487a-91d5-1e5171c5d801 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:22.067794 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.quota [None req-92f076d3-37ca-487a-91d5-1e5171c5d801 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Getting quotas for project f3d392a7d77f46fcb4faa017786796fa. Resources: {'ram', 'instances', 'cores'} {{(pid=116273) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 22 12:19:22.088778 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.quota [None req-92f076d3-37ca-487a-91d5-1e5171c5d801 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Getting quotas for user a1efac6c215148ce8c3ecdce1e9a8742 and project f3d392a7d77f46fcb4faa017786796fa. Resources: {'ram', 'instances', 'cores'} {{(pid=116273) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 22 12:19:22.121766 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-92f076d3-37ca-487a-91d5-1e5171c5d801 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Going to run 1 instances... {{(pid=116273) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 22 12:19:22.124582 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-92f076d3-37ca-487a-91d5-1e5171c5d801 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] [instance: 302ab8ef-5565-4f9b-9b91-b405d550a90d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='31affc49-b6f0-44da-af65-4c65d72458b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116273) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 22 12:19:22.188592 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-92f076d3-37ca-487a-91d5-1e5171c5d801 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.257691 Nov 22 12:19:22.190066 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 22/57] 10.222.0.66 () {60 vars in 1146 bytes} [Mon Nov 22 12:19:19 2021] POST /compute/v2.1/servers => generated 383 bytes in 2261 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 22 12:19:22.200162 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-1aefeb16-4413-4ec4-a5d9-3b6480f34897 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:19:22.200806 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-1aefeb16-4413-4ec4-a5d9-3b6480f34897 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] [instance: 302ab8ef-5565-4f9b-9b91-b405d550a90d] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:19:22.443075 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-1aefeb16-4413-4ec4-a5d9-3b6480f34897 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1efac6c215148ce8c3ecdce1e9a8742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d392a7d77f46fcb4faa017786796fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:19:22.446844 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-ba18c652-1284-45c8-9121-b70f0e95d906 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:19:22.451930 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-1aefeb16-4413-4ec4-a5d9-3b6480f34897 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] 10.222.0.66 "GET /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d" status: 200 len: 1222 microversion: 2.1 time: 0.255526 Nov 22 12:19:22.452512 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 36/58] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:19:22 2021] GET /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d => generated 1222 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:19:22.452805 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-ba18c652-1284-45c8-9121-b70f0e95d906 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] [instance: 09a121f0-f7e5-4376-96bf-7008344dfe06] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:19:22.558868 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-ba18c652-1284-45c8-9121-b70f0e95d906 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:22.559363 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-ba18c652-1284-45c8-9121-b70f0e95d906 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:22.560261 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-ba18c652-1284-45c8-9121-b70f0e95d906 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:22.560851 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-ba18c652-1284-45c8-9121-b70f0e95d906 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:22.737744 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-a854ab9a-09d2-4ce1-807c-35d4d9522c73 tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:19:22.738713 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-a854ab9a-09d2-4ce1-807c-35d4d9522c73 tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] [instance: 0e1fe798-845f-4f01-b699-0e2fac35e5c3] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:19:22.751142 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-a854ab9a-09d2-4ce1-807c-35d4d9522c73 tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:22.756329 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-a854ab9a-09d2-4ce1-807c-35d4d9522c73 tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:22.758578 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-a854ab9a-09d2-4ce1-807c-35d4d9522c73 tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:22.761932 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-a854ab9a-09d2-4ce1-807c-35d4d9522c73 tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:23.236271 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-ba18c652-1284-45c8-9121-b70f0e95d906 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b581fa25045cea9585ae4e707585d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5319fd2dee9b4b47b98f59bca1572ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:19:23.268749 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-ba18c652-1284-45c8-9121-b70f0e95d906 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] 10.222.0.66 "GET /compute/v2.1/servers/09a121f0-f7e5-4376-96bf-7008344dfe06" status: 200 len: 1318 microversion: 2.1 time: 0.819801 Nov 22 12:19:23.271857 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 23/59] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:19:22 2021] GET /compute/v2.1/servers/09a121f0-f7e5-4376-96bf-7008344dfe06 => generated 1318 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 12:19:23.287848 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-98fbcfb0-b739-4bbf-9044-4e59242fb575 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-124305078", "imageRef": "31affc49-b6f0-44da-af65-4c65d72458b9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "08903c03-f7d7-43c9-ab4d-565ac4637d53"}]}} {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:19:23.388810 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.network.neutron [None req-98fbcfb0-b739-4bbf-9044-4e59242fb575 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] validate_networks() for [('08903c03-f7d7-43c9-ab4d-565ac4637d53', None, None, None, None, None)] {{(pid=116273) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 22 12:19:23.399405 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-a854ab9a-09d2-4ce1-807c-35d4d9522c73 tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3127e81d7664dbbbce53d6d7f2bae4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c32f9960704ce6b26019efdc2abddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:19:23.415437 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-a854ab9a-09d2-4ce1-807c-35d4d9522c73 tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] 10.222.0.66 "GET /compute/v2.1/servers/0e1fe798-845f-4f01-b699-0e2fac35e5c3" status: 200 len: 1315 microversion: 2.1 time: 0.678909 Nov 22 12:19:23.416199 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 37/60] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:19:22 2021] GET /compute/v2.1/servers/0e1fe798-845f-4f01-b699-0e2fac35e5c3 => generated 1315 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:19:24.186638 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.virt.hardware [None req-98fbcfb0-b739-4bbf-9044-4e59242fb575 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Flavor limits 0:0:0 {{(pid=116273) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 22 12:19:24.187777 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.virt.hardware [None req-98fbcfb0-b739-4bbf-9044-4e59242fb575 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Image limits 0:0:0 {{(pid=116273) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 22 12:19:24.188648 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.virt.hardware [None req-98fbcfb0-b739-4bbf-9044-4e59242fb575 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Flavor pref 0:0:0 {{(pid=116273) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 22 12:19:24.190949 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.virt.hardware [None req-98fbcfb0-b739-4bbf-9044-4e59242fb575 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Image pref 0:0:0 {{(pid=116273) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 22 12:19:24.208421 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.virt.hardware [None req-98fbcfb0-b739-4bbf-9044-4e59242fb575 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116273) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 22 12:19:24.272287 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-98fbcfb0-b739-4bbf-9044-4e59242fb575 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:24.275936 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-98fbcfb0-b739-4bbf-9044-4e59242fb575 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:24.287886 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-98fbcfb0-b739-4bbf-9044-4e59242fb575 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:24.293402 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-5678df72-94b1-4c62-adc2-142e6a4b257b tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:19:24.294076 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-5678df72-94b1-4c62-adc2-142e6a4b257b tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] [instance: 09a121f0-f7e5-4376-96bf-7008344dfe06] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:19:24.302456 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-98fbcfb0-b739-4bbf-9044-4e59242fb575 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:24.308125 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-5678df72-94b1-4c62-adc2-142e6a4b257b tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:24.308639 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-5678df72-94b1-4c62-adc2-142e6a4b257b tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:24.314638 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-5678df72-94b1-4c62-adc2-142e6a4b257b tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:24.315482 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-5678df72-94b1-4c62-adc2-142e6a4b257b tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:24.376940 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.quota [None req-98fbcfb0-b739-4bbf-9044-4e59242fb575 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Getting quotas for project f3d392a7d77f46fcb4faa017786796fa. Resources: {'ram', 'instances', 'cores'} {{(pid=116273) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 22 12:19:24.388351 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.quota [None req-98fbcfb0-b739-4bbf-9044-4e59242fb575 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Getting quotas for user a1efac6c215148ce8c3ecdce1e9a8742 and project f3d392a7d77f46fcb4faa017786796fa. Resources: {'ram', 'instances', 'cores'} {{(pid=116273) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 22 12:19:24.460976 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-98fbcfb0-b739-4bbf-9044-4e59242fb575 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Going to run 1 instances... {{(pid=116273) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 22 12:19:24.470753 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-98fbcfb0-b739-4bbf-9044-4e59242fb575 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] [instance: 937d4958-6710-4c44-8451-2b659b87dc63] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='31affc49-b6f0-44da-af65-4c65d72458b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116273) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 22 12:19:24.657857 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-5678df72-94b1-4c62-adc2-142e6a4b257b tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b581fa25045cea9585ae4e707585d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5319fd2dee9b4b47b98f59bca1572ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:19:24.690725 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-98fbcfb0-b739-4bbf-9044-4e59242fb575 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.417241 Nov 22 12:19:24.699531 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 24/61] 10.222.0.66 () {60 vars in 1146 bytes} [Mon Nov 22 12:19:23 2021] POST /compute/v2.1/servers => generated 383 bytes in 1427 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 22 12:19:24.706936 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-5678df72-94b1-4c62-adc2-142e6a4b257b tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] 10.222.0.66 "GET /compute/v2.1/servers/09a121f0-f7e5-4376-96bf-7008344dfe06" status: 200 len: 1318 microversion: 2.1 time: 0.395941 Nov 22 12:19:24.709512 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-7b7e897e-e6c7-41fc-b0e0-96361e2a4926 tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:19:24.710777 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 38/62] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:19:24 2021] GET /compute/v2.1/servers/09a121f0-f7e5-4376-96bf-7008344dfe06 => generated 1318 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:19:24.712064 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-7b7e897e-e6c7-41fc-b0e0-96361e2a4926 tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] [instance: 0e1fe798-845f-4f01-b699-0e2fac35e5c3] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:19:24.728403 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-435dd8ab-6ceb-4d0a-9604-c36cdfaa9d41 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:19:24.729246 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-435dd8ab-6ceb-4d0a-9604-c36cdfaa9d41 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] [instance: 937d4958-6710-4c44-8451-2b659b87dc63] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:19:24.759391 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-7b7e897e-e6c7-41fc-b0e0-96361e2a4926 tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:24.761670 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-7b7e897e-e6c7-41fc-b0e0-96361e2a4926 tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:24.768253 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-7b7e897e-e6c7-41fc-b0e0-96361e2a4926 tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:24.770985 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-7b7e897e-e6c7-41fc-b0e0-96361e2a4926 tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:24.904850 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-435dd8ab-6ceb-4d0a-9604-c36cdfaa9d41 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1efac6c215148ce8c3ecdce1e9a8742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d392a7d77f46fcb4faa017786796fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:19:24.919764 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-435dd8ab-6ceb-4d0a-9604-c36cdfaa9d41 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] 10.222.0.66 "GET /compute/v2.1/servers/937d4958-6710-4c44-8451-2b659b87dc63" status: 200 len: 1221 microversion: 2.1 time: 0.200908 Nov 22 12:19:24.934865 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 39/63] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:19:24 2021] GET /compute/v2.1/servers/937d4958-6710-4c44-8451-2b659b87dc63 => generated 1221 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:19:25.332532 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-7b7e897e-e6c7-41fc-b0e0-96361e2a4926 tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3127e81d7664dbbbce53d6d7f2bae4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c32f9960704ce6b26019efdc2abddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:19:25.361673 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-7b7e897e-e6c7-41fc-b0e0-96361e2a4926 tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] 10.222.0.66 "GET /compute/v2.1/servers/0e1fe798-845f-4f01-b699-0e2fac35e5c3" status: 200 len: 1315 microversion: 2.1 time: 0.660184 Nov 22 12:19:25.365112 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 25/64] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:19:24 2021] GET /compute/v2.1/servers/0e1fe798-845f-4f01-b699-0e2fac35e5c3 => generated 1315 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:19:25.726586 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-f061a231-a59d-4092-95b9-9b09a58928f1 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:19:25.727893 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-f061a231-a59d-4092-95b9-9b09a58928f1 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] [instance: 09a121f0-f7e5-4376-96bf-7008344dfe06] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:19:25.738202 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-f061a231-a59d-4092-95b9-9b09a58928f1 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:25.740693 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-f061a231-a59d-4092-95b9-9b09a58928f1 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:25.743456 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-f061a231-a59d-4092-95b9-9b09a58928f1 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:25.744380 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-f061a231-a59d-4092-95b9-9b09a58928f1 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:25.950181 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-15857ee2-0479-4ec4-81ae-ea206b30aa5f tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:19:25.950794 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-15857ee2-0479-4ec4-81ae-ea206b30aa5f tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] [instance: 937d4958-6710-4c44-8451-2b659b87dc63] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:19:25.988944 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-15857ee2-0479-4ec4-81ae-ea206b30aa5f tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:26.000228 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-15857ee2-0479-4ec4-81ae-ea206b30aa5f tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:26.001411 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-15857ee2-0479-4ec4-81ae-ea206b30aa5f tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:26.014387 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-15857ee2-0479-4ec4-81ae-ea206b30aa5f tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:26.715456 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-15857ee2-0479-4ec4-81ae-ea206b30aa5f tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1efac6c215148ce8c3ecdce1e9a8742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d392a7d77f46fcb4faa017786796fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:19:26.772102 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-15857ee2-0479-4ec4-81ae-ea206b30aa5f tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] 10.222.0.66 "GET /compute/v2.1/servers/937d4958-6710-4c44-8451-2b659b87dc63" status: 200 len: 1225 microversion: 2.1 time: 0.825808 Nov 22 12:19:26.773760 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 26/65] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:19:25 2021] GET /compute/v2.1/servers/937d4958-6710-4c44-8451-2b659b87dc63 => generated 1225 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:19:27.193612 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-f061a231-a59d-4092-95b9-9b09a58928f1 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b581fa25045cea9585ae4e707585d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5319fd2dee9b4b47b98f59bca1572ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:19:27.204202 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-f061a231-a59d-4092-95b9-9b09a58928f1 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] 10.222.0.66 "GET /compute/v2.1/servers/09a121f0-f7e5-4376-96bf-7008344dfe06" status: 200 len: 1318 microversion: 2.1 time: 1.480554 Nov 22 12:19:27.209850 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 40/66] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:19:25 2021] GET /compute/v2.1/servers/09a121f0-f7e5-4376-96bf-7008344dfe06 => generated 1318 bytes in 1489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:19:27.222935 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-55780ea8-91d2-4b6f-842f-d530414cda6b tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:19:27.228129 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-55780ea8-91d2-4b6f-842f-d530414cda6b tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] [instance: 0e1fe798-845f-4f01-b699-0e2fac35e5c3] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:19:27.252964 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-55780ea8-91d2-4b6f-842f-d530414cda6b tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:27.255544 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-55780ea8-91d2-4b6f-842f-d530414cda6b tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:27.256727 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-55780ea8-91d2-4b6f-842f-d530414cda6b tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:27.263581 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-55780ea8-91d2-4b6f-842f-d530414cda6b tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:27.396343 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-8d5a5b8e-6ef2-4288-8670-dfb80aea7f65 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Action: 'create', calling method: .version_select at 0x7fa1a3f589d0>, body: {"keypair": {"name": "tempest-keypair-677996239"}} {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:19:27.492489 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.quota [None req-8d5a5b8e-6ef2-4288-8670-dfb80aea7f65 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Getting quotas for project 086a36bf2fea4df7a4d72733b2f68dcd. Resources: {'key_pairs'} {{(pid=116273) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 22 12:19:27.511075 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.quota [None req-8d5a5b8e-6ef2-4288-8670-dfb80aea7f65 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Getting quotas for user 31f429dd496b45b9a9c2c13341cca92f and project 086a36bf2fea4df7a4d72733b2f68dcd. Resources: {'key_pairs'} {{(pid=116273) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 22 12:19:27.966027 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-55780ea8-91d2-4b6f-842f-d530414cda6b tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3127e81d7664dbbbce53d6d7f2bae4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c32f9960704ce6b26019efdc2abddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:19:27.974115 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-55780ea8-91d2-4b6f-842f-d530414cda6b tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] 10.222.0.66 "GET /compute/v2.1/servers/0e1fe798-845f-4f01-b699-0e2fac35e5c3" status: 200 len: 1315 microversion: 2.1 time: 0.763005 Nov 22 12:19:27.975939 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 41/67] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:19:27 2021] GET /compute/v2.1/servers/0e1fe798-845f-4f01-b699-0e2fac35e5c3 => generated 1315 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:19:27.980681 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-b2b9dc65-123e-4226-a67c-e66230596404 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:19:27.988086 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-b2b9dc65-123e-4226-a67c-e66230596404 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] [instance: 937d4958-6710-4c44-8451-2b659b87dc63] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:19:27.994712 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-b2b9dc65-123e-4226-a67c-e66230596404 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:27.996080 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-b2b9dc65-123e-4226-a67c-e66230596404 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:28.005693 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-b2b9dc65-123e-4226-a67c-e66230596404 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:28.006364 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-b2b9dc65-123e-4226-a67c-e66230596404 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:28.154639 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-b2b9dc65-123e-4226-a67c-e66230596404 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1efac6c215148ce8c3ecdce1e9a8742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d392a7d77f46fcb4faa017786796fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:19:28.166092 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-b2b9dc65-123e-4226-a67c-e66230596404 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] 10.222.0.66 "GET /compute/v2.1/servers/937d4958-6710-4c44-8451-2b659b87dc63" status: 200 len: 1279 microversion: 2.1 time: 0.186409 Nov 22 12:19:28.180314 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 42/68] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:19:27 2021] GET /compute/v2.1/servers/937d4958-6710-4c44-8451-2b659b87dc63 => generated 1279 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:19:28.230533 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-b6af7808-efd1-4680-89cd-14655b4d73ec tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:19:28.232181 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-b6af7808-efd1-4680-89cd-14655b4d73ec tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] [instance: 09a121f0-f7e5-4376-96bf-7008344dfe06] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:19:28.265858 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-b6af7808-efd1-4680-89cd-14655b4d73ec tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:28.267601 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-b6af7808-efd1-4680-89cd-14655b4d73ec tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:28.270723 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-b6af7808-efd1-4680-89cd-14655b4d73ec tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:28.272277 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-b6af7808-efd1-4680-89cd-14655b4d73ec tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:28.926521 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.quota [None req-8d5a5b8e-6ef2-4288-8670-dfb80aea7f65 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Getting quotas for project 086a36bf2fea4df7a4d72733b2f68dcd. Resources: {'key_pairs'} {{(pid=116273) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 22 12:19:28.940253 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.quota [None req-8d5a5b8e-6ef2-4288-8670-dfb80aea7f65 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Getting quotas for user 31f429dd496b45b9a9c2c13341cca92f and project 086a36bf2fea4df7a4d72733b2f68dcd. Resources: {'key_pairs'} {{(pid=116273) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 22 12:19:28.968937 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-8d5a5b8e-6ef2-4288-8670-dfb80aea7f65 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 201 len: 2319 microversion: 2.20 time: 2.193742 Nov 22 12:19:28.970286 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 27/69] 10.222.0.66 () {62 vars in 1198 bytes} [Mon Nov 22 12:19:26 2021] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 2196 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Nov 22 12:19:29.114644 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [req-8fc60252-84d5-406e-8997-ee45d1d9eae4 req-22f56701-6074-426e-8373-b6452dd6e26b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09a121f0-f7e5-4376-96bf-7008344dfe06", "tag": "c07cfd45-5b74-4945-9991-863824fb50f3"}]} {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:19:29.118525 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 12:19:29.118525 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: warnings.warn(msg) Nov 22 12:19:29.158298 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [req-8fc60252-84d5-406e-8997-ee45d1d9eae4 req-22f56701-6074-426e-8373-b6452dd6e26b service nova] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:29.159512 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [req-8fc60252-84d5-406e-8997-ee45d1d9eae4 req-22f56701-6074-426e-8373-b6452dd6e26b service nova] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:29.204424 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.compute.server_external_events [req-8fc60252-84d5-406e-8997-ee45d1d9eae4 req-22f56701-6074-426e-8373-b6452dd6e26b service nova] Creating event network-changed:c07cfd45-5b74-4945-9991-863824fb50f3 for instance 09a121f0-f7e5-4376-96bf-7008344dfe06 on hv-cinder-76845 Nov 22 12:19:29.209963 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [req-8fc60252-84d5-406e-8997-ee45d1d9eae4 req-22f56701-6074-426e-8373-b6452dd6e26b service nova] Acquired lock "compute-rpcapi-router" {{(pid=116273) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Nov 22 12:19:29.215015 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-f3e4dd57-6224-44bc-954d-e4c43a3a7dc5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:29.215645 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-f3e4dd57-6224-44bc-954d-e4c43a3a7dc5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:29.216580 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-f3e4dd57-6224-44bc-954d-e4c43a3a7dc5 None None] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:29.221467 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-f3e4dd57-6224-44bc-954d-e4c43a3a7dc5 None None] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:29.240064 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.compute.rpcapi [None req-f3e4dd57-6224-44bc-954d-e4c43a3a7dc5 None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Nov 22 12:19:29.248199 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-f3e4dd57-6224-44bc-954d-e4c43a3a7dc5 None None] Releasing lock "compute-rpcapi-router" {{(pid=116273) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 22 12:19:29.316830 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-f3e4dd57-6224-44bc-954d-e4c43a3a7dc5 None None] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.345082 Nov 22 12:19:29.317880 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 28/70] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Nov 22 12:19:28 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 12:19:29.328645 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-f21a0a13-a19e-4ebf-9f3f-054e8fb54f58 tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:19:29.328645 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-f21a0a13-a19e-4ebf-9f3f-054e8fb54f58 tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] [instance: 0e1fe798-845f-4f01-b699-0e2fac35e5c3] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:19:29.337706 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-f21a0a13-a19e-4ebf-9f3f-054e8fb54f58 tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:29.345749 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-f21a0a13-a19e-4ebf-9f3f-054e8fb54f58 tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:29.346755 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-f21a0a13-a19e-4ebf-9f3f-054e8fb54f58 tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:29.347361 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-f21a0a13-a19e-4ebf-9f3f-054e8fb54f58 tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:29.953642 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-f21a0a13-a19e-4ebf-9f3f-054e8fb54f58 tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3127e81d7664dbbbce53d6d7f2bae4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c32f9960704ce6b26019efdc2abddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:19:29.965167 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-f21a0a13-a19e-4ebf-9f3f-054e8fb54f58 tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] 10.222.0.66 "GET /compute/v2.1/servers/0e1fe798-845f-4f01-b699-0e2fac35e5c3" status: 200 len: 1315 microversion: 2.1 time: 0.645772 Nov 22 12:19:29.965914 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 29/71] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:19:29 2021] GET /compute/v2.1/servers/0e1fe798-845f-4f01-b699-0e2fac35e5c3 => generated 1315 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:19:29.970639 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-368c1190-8c56-47a9-bae1-be390ba492f6 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:19:29.990650 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-368c1190-8c56-47a9-bae1-be390ba492f6 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] [instance: 937d4958-6710-4c44-8451-2b659b87dc63] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:19:30.012747 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-368c1190-8c56-47a9-bae1-be390ba492f6 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:30.014098 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-368c1190-8c56-47a9-bae1-be390ba492f6 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:30.015102 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-368c1190-8c56-47a9-bae1-be390ba492f6 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:30.020626 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-b6af7808-efd1-4680-89cd-14655b4d73ec tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b581fa25045cea9585ae4e707585d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5319fd2dee9b4b47b98f59bca1572ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:19:30.035813 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-b6af7808-efd1-4680-89cd-14655b4d73ec tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] 10.222.0.66 "GET /compute/v2.1/servers/09a121f0-f7e5-4376-96bf-7008344dfe06" status: 200 len: 1318 microversion: 2.1 time: 1.811584 Nov 22 12:19:30.044165 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-368c1190-8c56-47a9-bae1-be390ba492f6 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:30.052806 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 43/72] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:19:28 2021] GET /compute/v2.1/servers/09a121f0-f7e5-4376-96bf-7008344dfe06 => generated 1318 bytes in 1831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 12:19:30.356839 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-368c1190-8c56-47a9-bae1-be390ba492f6 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1efac6c215148ce8c3ecdce1e9a8742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d392a7d77f46fcb4faa017786796fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:19:30.366322 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-368c1190-8c56-47a9-bae1-be390ba492f6 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] 10.222.0.66 "GET /compute/v2.1/servers/937d4958-6710-4c44-8451-2b659b87dc63" status: 200 len: 1279 microversion: 2.1 time: 0.399301 Nov 22 12:19:30.366923 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 30/73] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:19:29 2021] GET /compute/v2.1/servers/937d4958-6710-4c44-8451-2b659b87dc63 => generated 1279 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:19:30.989017 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-29b0e9c6-b0e8-41b3-b0e6-b4f390041a4b tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:19:30.990082 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-29b0e9c6-b0e8-41b3-b0e6-b4f390041a4b tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] [instance: 0e1fe798-845f-4f01-b699-0e2fac35e5c3] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:19:31.006711 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-29b0e9c6-b0e8-41b3-b0e6-b4f390041a4b tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:31.007178 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-29b0e9c6-b0e8-41b3-b0e6-b4f390041a4b tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:31.008025 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-29b0e9c6-b0e8-41b3-b0e6-b4f390041a4b tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:31.029282 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-29b0e9c6-b0e8-41b3-b0e6-b4f390041a4b tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:31.064687 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-dfd7b0eb-979e-4dfb-ae1d-4a6ca679c31f tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:19:31.066186 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-dfd7b0eb-979e-4dfb-ae1d-4a6ca679c31f tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] [instance: 09a121f0-f7e5-4376-96bf-7008344dfe06] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:19:31.080720 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-dfd7b0eb-979e-4dfb-ae1d-4a6ca679c31f tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:31.081398 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-dfd7b0eb-979e-4dfb-ae1d-4a6ca679c31f tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:31.082876 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-dfd7b0eb-979e-4dfb-ae1d-4a6ca679c31f tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:31.083745 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-dfd7b0eb-979e-4dfb-ae1d-4a6ca679c31f tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:32.319697 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-29b0e9c6-b0e8-41b3-b0e6-b4f390041a4b tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3127e81d7664dbbbce53d6d7f2bae4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c32f9960704ce6b26019efdc2abddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:19:32.329212 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-29b0e9c6-b0e8-41b3-b0e6-b4f390041a4b tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] 10.222.0.66 "GET /compute/v2.1/servers/0e1fe798-845f-4f01-b699-0e2fac35e5c3" status: 200 len: 1315 microversion: 2.1 time: 1.346446 Nov 22 12:19:32.340689 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 44/74] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:19:30 2021] GET /compute/v2.1/servers/0e1fe798-845f-4f01-b699-0e2fac35e5c3 => generated 1315 bytes in 1358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:19:32.341791 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-dfd7b0eb-979e-4dfb-ae1d-4a6ca679c31f tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b581fa25045cea9585ae4e707585d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5319fd2dee9b4b47b98f59bca1572ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:19:32.348336 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-a74b9bce-982b-4bdd-b160-81623741a536 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:19:32.350855 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-a74b9bce-982b-4bdd-b160-81623741a536 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] [instance: 937d4958-6710-4c44-8451-2b659b87dc63] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:19:32.352835 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-dfd7b0eb-979e-4dfb-ae1d-4a6ca679c31f tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] 10.222.0.66 "GET /compute/v2.1/servers/09a121f0-f7e5-4376-96bf-7008344dfe06" status: 200 len: 1318 microversion: 2.1 time: 1.295092 Nov 22 12:19:32.353447 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 31/75] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:19:31 2021] GET /compute/v2.1/servers/09a121f0-f7e5-4376-96bf-7008344dfe06 => generated 1318 bytes in 1296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:19:32.366971 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [req-3c4e45ec-96a6-483f-94fc-8d2aa3de2742 req-2acee005-d827-4b3d-aebd-394d73f8d10b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e1fe798-845f-4f01-b699-0e2fac35e5c3", "tag": "bbc86ff1-847c-4237-907d-5d5ba197dac4"}]} {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:19:32.377622 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 12:19:32.377622 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: warnings.warn(msg) Nov 22 12:19:32.390434 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-a74b9bce-982b-4bdd-b160-81623741a536 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:32.397549 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-a74b9bce-982b-4bdd-b160-81623741a536 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:32.398813 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-a74b9bce-982b-4bdd-b160-81623741a536 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:32.399821 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-a74b9bce-982b-4bdd-b160-81623741a536 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:32.401488 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [req-3c4e45ec-96a6-483f-94fc-8d2aa3de2742 req-2acee005-d827-4b3d-aebd-394d73f8d10b service nova] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:32.402338 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [req-3c4e45ec-96a6-483f-94fc-8d2aa3de2742 req-2acee005-d827-4b3d-aebd-394d73f8d10b service nova] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:32.427916 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.compute.server_external_events [req-3c4e45ec-96a6-483f-94fc-8d2aa3de2742 req-2acee005-d827-4b3d-aebd-394d73f8d10b service nova] Creating event network-changed:bbc86ff1-847c-4237-907d-5d5ba197dac4 for instance 0e1fe798-845f-4f01-b699-0e2fac35e5c3 on hv-cinder-76845 Nov 22 12:19:32.442058 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [req-3c4e45ec-96a6-483f-94fc-8d2aa3de2742 req-2acee005-d827-4b3d-aebd-394d73f8d10b service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085189 Nov 22 12:19:32.442678 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 32/76] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Nov 22 12:19:32 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 12:19:32.598821 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-a74b9bce-982b-4bdd-b160-81623741a536 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1efac6c215148ce8c3ecdce1e9a8742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d392a7d77f46fcb4faa017786796fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:19:32.610585 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-a74b9bce-982b-4bdd-b160-81623741a536 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] 10.222.0.66 "GET /compute/v2.1/servers/937d4958-6710-4c44-8451-2b659b87dc63" status: 200 len: 1279 microversion: 2.1 time: 0.267466 Nov 22 12:19:32.611284 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 45/77] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:19:32 2021] GET /compute/v2.1/servers/937d4958-6710-4c44-8451-2b659b87dc63 => generated 1279 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:19:33.346432 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-c8bac7e3-aa14-4c5c-823b-caeb55a27d0a tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:19:33.347431 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-c8bac7e3-aa14-4c5c-823b-caeb55a27d0a tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] [instance: 0e1fe798-845f-4f01-b699-0e2fac35e5c3] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:19:33.357993 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-c8bac7e3-aa14-4c5c-823b-caeb55a27d0a tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:33.358459 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-c8bac7e3-aa14-4c5c-823b-caeb55a27d0a tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:33.359269 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-c8bac7e3-aa14-4c5c-823b-caeb55a27d0a tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:33.362603 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-c8bac7e3-aa14-4c5c-823b-caeb55a27d0a tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:33.384100 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-031135ee-f02f-4647-9f5c-82fa5b88ce88 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:19:33.385909 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-031135ee-f02f-4647-9f5c-82fa5b88ce88 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] [instance: 09a121f0-f7e5-4376-96bf-7008344dfe06] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:19:33.399391 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-031135ee-f02f-4647-9f5c-82fa5b88ce88 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:33.401492 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-031135ee-f02f-4647-9f5c-82fa5b88ce88 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:33.403760 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-031135ee-f02f-4647-9f5c-82fa5b88ce88 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:33.406894 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-031135ee-f02f-4647-9f5c-82fa5b88ce88 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:34.127410 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-c8bac7e3-aa14-4c5c-823b-caeb55a27d0a tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3127e81d7664dbbbce53d6d7f2bae4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c32f9960704ce6b26019efdc2abddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:19:34.138525 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-c8bac7e3-aa14-4c5c-823b-caeb55a27d0a tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] 10.222.0.66 "GET /compute/v2.1/servers/0e1fe798-845f-4f01-b699-0e2fac35e5c3" status: 200 len: 1315 microversion: 2.1 time: 0.794719 Nov 22 12:19:34.141852 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 33/78] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:19:33 2021] GET /compute/v2.1/servers/0e1fe798-845f-4f01-b699-0e2fac35e5c3 => generated 1315 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:19:34.150227 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-483939ba-7266-4fad-b6b7-20ee17daf34d tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:19:34.155356 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-483939ba-7266-4fad-b6b7-20ee17daf34d tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] [instance: 937d4958-6710-4c44-8451-2b659b87dc63] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:19:34.166094 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-483939ba-7266-4fad-b6b7-20ee17daf34d tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:34.180009 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-483939ba-7266-4fad-b6b7-20ee17daf34d tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:34.182716 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-031135ee-f02f-4647-9f5c-82fa5b88ce88 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b581fa25045cea9585ae4e707585d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5319fd2dee9b4b47b98f59bca1572ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:19:34.184027 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-483939ba-7266-4fad-b6b7-20ee17daf34d tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:34.185792 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-483939ba-7266-4fad-b6b7-20ee17daf34d tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:34.192062 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-031135ee-f02f-4647-9f5c-82fa5b88ce88 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] 10.222.0.66 "GET /compute/v2.1/servers/09a121f0-f7e5-4376-96bf-7008344dfe06" status: 200 len: 1318 microversion: 2.1 time: 0.811943 Nov 22 12:19:34.192642 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 46/79] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:19:33 2021] GET /compute/v2.1/servers/09a121f0-f7e5-4376-96bf-7008344dfe06 => generated 1318 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:19:34.959269 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-483939ba-7266-4fad-b6b7-20ee17daf34d tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1efac6c215148ce8c3ecdce1e9a8742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d392a7d77f46fcb4faa017786796fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:19:34.972723 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-483939ba-7266-4fad-b6b7-20ee17daf34d tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] 10.222.0.66 "GET /compute/v2.1/servers/937d4958-6710-4c44-8451-2b659b87dc63" status: 200 len: 1321 microversion: 2.1 time: 0.828589 Nov 22 12:19:34.986045 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 34/80] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:19:34 2021] GET /compute/v2.1/servers/937d4958-6710-4c44-8451-2b659b87dc63 => generated 1321 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:19:35.120501 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-7a2f35de-9df6-4bbc-82a0-313c141d083a tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1897582767", "imageRef": "31affc49-b6f0-44da-af65-4c65d72458b9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "47c7c2df-c485-45be-9ae4-891cba4c7953"}], "security_groups": [{"name": "tempest-securitygroup--1656050520"}], "key_name": "tempest-keypair-677996239", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:19:35.158173 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-6be8cd46-20de-4893-b806-aa63fc44f7f2 tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:19:35.159578 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-6be8cd46-20de-4893-b806-aa63fc44f7f2 tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] [instance: 0e1fe798-845f-4f01-b699-0e2fac35e5c3] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:19:35.172686 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-6be8cd46-20de-4893-b806-aa63fc44f7f2 tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:35.174846 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-6be8cd46-20de-4893-b806-aa63fc44f7f2 tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:35.178011 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-6be8cd46-20de-4893-b806-aa63fc44f7f2 tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:35.180422 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-6be8cd46-20de-4893-b806-aa63fc44f7f2 tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:35.842714 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.network.neutron [None req-7a2f35de-9df6-4bbc-82a0-313c141d083a tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] validate_networks() for [('47c7c2df-c485-45be-9ae4-891cba4c7953', None, None, None, None, None)] {{(pid=116272) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 22 12:19:36.512527 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-6be8cd46-20de-4893-b806-aa63fc44f7f2 tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3127e81d7664dbbbce53d6d7f2bae4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c32f9960704ce6b26019efdc2abddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:19:36.521794 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-6be8cd46-20de-4893-b806-aa63fc44f7f2 tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] 10.222.0.66 "GET /compute/v2.1/servers/0e1fe798-845f-4f01-b699-0e2fac35e5c3" status: 200 len: 1315 microversion: 2.1 time: 1.367630 Nov 22 12:19:36.535390 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 35/81] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:19:35 2021] GET /compute/v2.1/servers/0e1fe798-845f-4f01-b699-0e2fac35e5c3 => generated 1315 bytes in 1382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 12:19:36.543291 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-0d12fd3d-3215-4aeb-815a-4964ccf6230b tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:19:36.544837 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-0d12fd3d-3215-4aeb-815a-4964ccf6230b tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] [instance: 09a121f0-f7e5-4376-96bf-7008344dfe06] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:19:36.553201 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-0d12fd3d-3215-4aeb-815a-4964ccf6230b tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:36.553871 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-0d12fd3d-3215-4aeb-815a-4964ccf6230b tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:36.555478 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-0d12fd3d-3215-4aeb-815a-4964ccf6230b tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:36.556122 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-0d12fd3d-3215-4aeb-815a-4964ccf6230b tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:37.058695 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-0d12fd3d-3215-4aeb-815a-4964ccf6230b tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b581fa25045cea9585ae4e707585d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5319fd2dee9b4b47b98f59bca1572ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:19:37.068308 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-0d12fd3d-3215-4aeb-815a-4964ccf6230b tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] 10.222.0.66 "GET /compute/v2.1/servers/09a121f0-f7e5-4376-96bf-7008344dfe06" status: 200 len: 1318 microversion: 2.1 time: 0.531335 Nov 22 12:19:37.069321 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 36/82] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:19:36 2021] GET /compute/v2.1/servers/09a121f0-f7e5-4376-96bf-7008344dfe06 => generated 1318 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:19:37.076221 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-a109724b-8248-450e-b209-f4c3bd678f8e tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:19:37.077515 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-a109724b-8248-450e-b209-f4c3bd678f8e tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] [instance: 937d4958-6710-4c44-8451-2b659b87dc63] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:19:37.086428 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-a109724b-8248-450e-b209-f4c3bd678f8e tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:37.086991 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-a109724b-8248-450e-b209-f4c3bd678f8e tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:37.087906 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-a109724b-8248-450e-b209-f4c3bd678f8e tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:37.088748 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-a109724b-8248-450e-b209-f4c3bd678f8e tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:37.154466 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.virt.hardware [None req-7a2f35de-9df6-4bbc-82a0-313c141d083a tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Flavor limits 0:0:0 {{(pid=116272) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 22 12:19:37.156056 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.virt.hardware [None req-7a2f35de-9df6-4bbc-82a0-313c141d083a tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Image limits 0:0:0 {{(pid=116272) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 22 12:19:37.157091 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.virt.hardware [None req-7a2f35de-9df6-4bbc-82a0-313c141d083a tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Flavor pref 0:0:0 {{(pid=116272) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 22 12:19:37.158045 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.virt.hardware [None req-7a2f35de-9df6-4bbc-82a0-313c141d083a tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Image pref 0:0:0 {{(pid=116272) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 22 12:19:37.158817 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.virt.hardware [None req-7a2f35de-9df6-4bbc-82a0-313c141d083a tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116272) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 22 12:19:37.172334 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-7a2f35de-9df6-4bbc-82a0-313c141d083a tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:37.172797 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-7a2f35de-9df6-4bbc-82a0-313c141d083a tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:37.173926 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-7a2f35de-9df6-4bbc-82a0-313c141d083a tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:37.174552 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-7a2f35de-9df6-4bbc-82a0-313c141d083a tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:37.194635 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.quota [None req-7a2f35de-9df6-4bbc-82a0-313c141d083a tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Getting quotas for project 086a36bf2fea4df7a4d72733b2f68dcd. Resources: {'ram', 'instances', 'cores'} {{(pid=116272) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 22 12:19:37.199687 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.quota [None req-7a2f35de-9df6-4bbc-82a0-313c141d083a tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Getting quotas for user 31f429dd496b45b9a9c2c13341cca92f and project 086a36bf2fea4df7a4d72733b2f68dcd. Resources: {'ram', 'instances', 'cores'} {{(pid=116272) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 22 12:19:37.223697 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-7a2f35de-9df6-4bbc-82a0-313c141d083a tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Going to run 1 instances... {{(pid=116272) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 22 12:19:37.225885 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-7a2f35de-9df6-4bbc-82a0-313c141d083a tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: c9f6d441-246f-479e-8e88-ea701c0f87ff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='31affc49-b6f0-44da-af65-4c65d72458b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116272) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 22 12:19:37.314177 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-7a2f35de-9df6-4bbc-82a0-313c141d083a tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 2.197884 Nov 22 12:19:37.328662 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 47/83] 10.222.0.66 () {62 vars in 1187 bytes} [Mon Nov 22 12:19:35 2021] POST /compute/v2.1/servers => generated 402 bytes in 2214 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 22 12:19:37.552954 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [req-7ba4894e-ed8b-45b3-9d7e-e2d2c418d4d2 req-2d062576-1336-4981-8e27-799e52728129 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "302ab8ef-5565-4f9b-9b91-b405d550a90d", "tag": "1fa9e48d-814b-49fa-b645-de1efce73a7d"}]} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:19:37.555169 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 12:19:37.555169 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: warnings.warn(msg) Nov 22 12:19:37.578589 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [req-7ba4894e-ed8b-45b3-9d7e-e2d2c418d4d2 req-2d062576-1336-4981-8e27-799e52728129 service nova] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:37.579028 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [req-7ba4894e-ed8b-45b3-9d7e-e2d2c418d4d2 req-2d062576-1336-4981-8e27-799e52728129 service nova] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:37.624907 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.compute.server_external_events [req-7ba4894e-ed8b-45b3-9d7e-e2d2c418d4d2 req-2d062576-1336-4981-8e27-799e52728129 service nova] Creating event network-changed:1fa9e48d-814b-49fa-b645-de1efce73a7d for instance 302ab8ef-5565-4f9b-9b91-b405d550a90d on hv-cinder-76845 Nov 22 12:19:37.625802 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [req-7ba4894e-ed8b-45b3-9d7e-e2d2c418d4d2 req-2d062576-1336-4981-8e27-799e52728129 service nova] Acquired lock "compute-rpcapi-router" {{(pid=116272) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Nov 22 12:19:37.628425 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-40a41d27-4e6e-4a62-a0e3-9010ea23592a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:37.629267 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-40a41d27-4e6e-4a62-a0e3-9010ea23592a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:37.632548 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-40a41d27-4e6e-4a62-a0e3-9010ea23592a None None] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:37.633519 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-40a41d27-4e6e-4a62-a0e3-9010ea23592a None None] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:37.647623 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-a109724b-8248-450e-b209-f4c3bd678f8e tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1efac6c215148ce8c3ecdce1e9a8742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d392a7d77f46fcb4faa017786796fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:19:37.650590 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.compute.rpcapi [None req-40a41d27-4e6e-4a62-a0e3-9010ea23592a None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Nov 22 12:19:37.651571 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-40a41d27-4e6e-4a62-a0e3-9010ea23592a None None] Releasing lock "compute-rpcapi-router" {{(pid=116272) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 22 12:19:37.672780 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-a109724b-8248-450e-b209-f4c3bd678f8e tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] 10.222.0.66 "GET /compute/v2.1/servers/937d4958-6710-4c44-8451-2b659b87dc63" status: 200 len: 1321 microversion: 2.1 time: 0.594986 Nov 22 12:19:37.675559 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 37/84] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:19:37 2021] GET /compute/v2.1/servers/937d4958-6710-4c44-8451-2b659b87dc63 => generated 1321 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:19:37.683124 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-dc5baec5-fc53-4fdd-a9e7-bab36f7eb66d tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:19:37.684461 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-dc5baec5-fc53-4fdd-a9e7-bab36f7eb66d tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: c9f6d441-246f-479e-8e88-ea701c0f87ff] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:19:37.709386 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-40a41d27-4e6e-4a62-a0e3-9010ea23592a None None] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.373061 Nov 22 12:19:37.713248 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 48/85] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Nov 22 12:19:37 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 12:19:37.723199 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-873b52d1-60e6-4912-bd6c-bf589b5c149b tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:19:37.724369 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-873b52d1-60e6-4912-bd6c-bf589b5c149b tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] [instance: 0e1fe798-845f-4f01-b699-0e2fac35e5c3] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:19:37.734514 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-873b52d1-60e6-4912-bd6c-bf589b5c149b tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:37.735428 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-873b52d1-60e6-4912-bd6c-bf589b5c149b tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:37.736861 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-873b52d1-60e6-4912-bd6c-bf589b5c149b tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:37.737991 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-873b52d1-60e6-4912-bd6c-bf589b5c149b tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:37.897063 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-dc5baec5-fc53-4fdd-a9e7-bab36f7eb66d tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:19:37.906841 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-dc5baec5-fc53-4fdd-a9e7-bab36f7eb66d tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:19:37.912304 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-dc5baec5-fc53-4fdd-a9e7-bab36f7eb66d tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:19:37.914550 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-dc5baec5-fc53-4fdd-a9e7-bab36f7eb66d tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff" status: 200 len: 1281 microversion: 2.20 time: 0.235993 Nov 22 12:19:37.923638 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 38/86] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Nov 22 12:19:37 2021] GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff => generated 1281 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 12:19:38.091066 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-81d33ef0-91f3-482e-92fc-86fd76bce628 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:19:38.091873 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-81d33ef0-91f3-482e-92fc-86fd76bce628 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] [instance: 09a121f0-f7e5-4376-96bf-7008344dfe06] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:19:38.102974 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-81d33ef0-91f3-482e-92fc-86fd76bce628 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:38.103461 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-81d33ef0-91f3-482e-92fc-86fd76bce628 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:38.104251 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-81d33ef0-91f3-482e-92fc-86fd76bce628 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:38.120282 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-81d33ef0-91f3-482e-92fc-86fd76bce628 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:38.585627 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-873b52d1-60e6-4912-bd6c-bf589b5c149b tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3127e81d7664dbbbce53d6d7f2bae4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c32f9960704ce6b26019efdc2abddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:19:38.597035 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-873b52d1-60e6-4912-bd6c-bf589b5c149b tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] 10.222.0.66 "GET /compute/v2.1/servers/0e1fe798-845f-4f01-b699-0e2fac35e5c3" status: 200 len: 1315 microversion: 2.1 time: 0.880094 Nov 22 12:19:38.599572 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 49/87] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:19:37 2021] GET /compute/v2.1/servers/0e1fe798-845f-4f01-b699-0e2fac35e5c3 => generated 1315 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:19:38.713620 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [req-71b343c2-0a7a-47fa-bbe9-7baa1cc5dfb6 req-078f4dac-8c3e-4071-926b-2f64a07e161e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e1fe798-845f-4f01-b699-0e2fac35e5c3", "name": "network-vif-plugged", "status": "completed", "tag": "bbc86ff1-847c-4237-907d-5d5ba197dac4"}]} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:19:38.716403 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 12:19:38.716403 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: warnings.warn(msg) Nov 22 12:19:38.731331 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [req-71b343c2-0a7a-47fa-bbe9-7baa1cc5dfb6 req-078f4dac-8c3e-4071-926b-2f64a07e161e service nova] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:38.733737 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [req-71b343c2-0a7a-47fa-bbe9-7baa1cc5dfb6 req-078f4dac-8c3e-4071-926b-2f64a07e161e service nova] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:38.760387 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.compute.server_external_events [req-71b343c2-0a7a-47fa-bbe9-7baa1cc5dfb6 req-078f4dac-8c3e-4071-926b-2f64a07e161e service nova] Creating event network-vif-plugged:bbc86ff1-847c-4237-907d-5d5ba197dac4 for instance 0e1fe798-845f-4f01-b699-0e2fac35e5c3 on hv-cinder-76845 Nov 22 12:19:38.791289 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [req-71b343c2-0a7a-47fa-bbe9-7baa1cc5dfb6 req-078f4dac-8c3e-4071-926b-2f64a07e161e service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.190283 Nov 22 12:19:38.796468 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 50/88] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Nov 22 12:19:38 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 12:19:38.816421 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-24a179b8-52d6-4157-bfc6-9c42d23e0fa5 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:19:38.817356 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-24a179b8-52d6-4157-bfc6-9c42d23e0fa5 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] [instance: 937d4958-6710-4c44-8451-2b659b87dc63] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:19:38.842573 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-24a179b8-52d6-4157-bfc6-9c42d23e0fa5 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:38.845621 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-24a179b8-52d6-4157-bfc6-9c42d23e0fa5 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:38.847636 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-24a179b8-52d6-4157-bfc6-9c42d23e0fa5 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:38.851270 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-24a179b8-52d6-4157-bfc6-9c42d23e0fa5 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:38.919067 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-81d33ef0-91f3-482e-92fc-86fd76bce628 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b581fa25045cea9585ae4e707585d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5319fd2dee9b4b47b98f59bca1572ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:19:38.934289 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-81d33ef0-91f3-482e-92fc-86fd76bce628 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] 10.222.0.66 "GET /compute/v2.1/servers/09a121f0-f7e5-4376-96bf-7008344dfe06" status: 200 len: 1318 microversion: 2.1 time: 0.851421 Nov 22 12:19:38.937809 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 39/89] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:19:38 2021] GET /compute/v2.1/servers/09a121f0-f7e5-4376-96bf-7008344dfe06 => generated 1318 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:19:38.950997 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-f32eddf1-ba2d-41b4-ba99-9e739fe78c3d tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:19:38.956010 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-f32eddf1-ba2d-41b4-ba99-9e739fe78c3d tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: c9f6d441-246f-479e-8e88-ea701c0f87ff] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:19:38.964175 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-f32eddf1-ba2d-41b4-ba99-9e739fe78c3d tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:38.966041 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-f32eddf1-ba2d-41b4-ba99-9e739fe78c3d tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:38.967559 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-f32eddf1-ba2d-41b4-ba99-9e739fe78c3d tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:38.968220 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-f32eddf1-ba2d-41b4-ba99-9e739fe78c3d tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:39.152396 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-f32eddf1-ba2d-41b4-ba99-9e739fe78c3d tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:19:39.162343 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-f32eddf1-ba2d-41b4-ba99-9e739fe78c3d tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:19:39.164461 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-f32eddf1-ba2d-41b4-ba99-9e739fe78c3d tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:19:39.165976 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-f32eddf1-ba2d-41b4-ba99-9e739fe78c3d tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff" status: 200 len: 1341 microversion: 2.20 time: 0.224437 Nov 22 12:19:39.166735 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 40/90] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Nov 22 12:19:38 2021] GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff => generated 1341 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 12:19:39.267933 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-24a179b8-52d6-4157-bfc6-9c42d23e0fa5 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1efac6c215148ce8c3ecdce1e9a8742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d392a7d77f46fcb4faa017786796fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:19:39.275101 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-24a179b8-52d6-4157-bfc6-9c42d23e0fa5 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] 10.222.0.66 "GET /compute/v2.1/servers/937d4958-6710-4c44-8451-2b659b87dc63" status: 200 len: 1321 microversion: 2.1 time: 0.477442 Nov 22 12:19:39.275759 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 51/91] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:19:38 2021] GET /compute/v2.1/servers/937d4958-6710-4c44-8451-2b659b87dc63 => generated 1321 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:19:39.616552 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-86b3fbd3-8d7a-434f-a114-922e0b06df1c tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:19:39.617163 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-86b3fbd3-8d7a-434f-a114-922e0b06df1c tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] [instance: 0e1fe798-845f-4f01-b699-0e2fac35e5c3] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:19:39.624546 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-86b3fbd3-8d7a-434f-a114-922e0b06df1c tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:39.625637 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-86b3fbd3-8d7a-434f-a114-922e0b06df1c tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:39.629064 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-86b3fbd3-8d7a-434f-a114-922e0b06df1c tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:39.629621 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-86b3fbd3-8d7a-434f-a114-922e0b06df1c tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:39.741888 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [req-e62a84c3-5a9f-4ffd-84e1-9c04a2a38168 req-b4d70550-ea31-4012-9fbd-8829ad15fdf6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "937d4958-6710-4c44-8451-2b659b87dc63", "tag": "4c9b376a-8f72-407b-9a92-78116503f6ab"}]} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:19:39.744517 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 12:19:39.744517 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: warnings.warn(msg) Nov 22 12:19:39.760952 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [req-e62a84c3-5a9f-4ffd-84e1-9c04a2a38168 req-b4d70550-ea31-4012-9fbd-8829ad15fdf6 service nova] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:39.768496 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [req-e62a84c3-5a9f-4ffd-84e1-9c04a2a38168 req-b4d70550-ea31-4012-9fbd-8829ad15fdf6 service nova] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:39.781085 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.compute.server_external_events [req-e62a84c3-5a9f-4ffd-84e1-9c04a2a38168 req-b4d70550-ea31-4012-9fbd-8829ad15fdf6 service nova] Creating event network-changed:4c9b376a-8f72-407b-9a92-78116503f6ab for instance 937d4958-6710-4c44-8451-2b659b87dc63 on hv-cinder-76845 Nov 22 12:19:39.787155 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [req-e62a84c3-5a9f-4ffd-84e1-9c04a2a38168 req-b4d70550-ea31-4012-9fbd-8829ad15fdf6 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051116 Nov 22 12:19:39.788184 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 52/92] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Nov 22 12:19:39 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 12:19:39.829457 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-86b3fbd3-8d7a-434f-a114-922e0b06df1c tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3127e81d7664dbbbce53d6d7f2bae4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c32f9960704ce6b26019efdc2abddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:19:39.836917 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-86b3fbd3-8d7a-434f-a114-922e0b06df1c tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] 10.222.0.66 "GET /compute/v2.1/servers/0e1fe798-845f-4f01-b699-0e2fac35e5c3" status: 200 len: 1315 microversion: 2.1 time: 0.224908 Nov 22 12:19:39.837467 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 41/93] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:19:39 2021] GET /compute/v2.1/servers/0e1fe798-845f-4f01-b699-0e2fac35e5c3 => generated 1315 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:19:39.955069 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-05b0a3bd-d857-477b-8e6b-6e8d8058f6a5 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:19:39.956382 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-05b0a3bd-d857-477b-8e6b-6e8d8058f6a5 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] [instance: 09a121f0-f7e5-4376-96bf-7008344dfe06] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:19:39.964426 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-05b0a3bd-d857-477b-8e6b-6e8d8058f6a5 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:39.965166 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-05b0a3bd-d857-477b-8e6b-6e8d8058f6a5 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:39.966938 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-05b0a3bd-d857-477b-8e6b-6e8d8058f6a5 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:39.979464 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-05b0a3bd-d857-477b-8e6b-6e8d8058f6a5 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:40.186318 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-c861c622-b26b-40b0-9550-75512d11da7b tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:19:40.187751 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-c861c622-b26b-40b0-9550-75512d11da7b tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: c9f6d441-246f-479e-8e88-ea701c0f87ff] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:19:40.196724 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-c861c622-b26b-40b0-9550-75512d11da7b tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:40.200414 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-c861c622-b26b-40b0-9550-75512d11da7b tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:40.201383 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-c861c622-b26b-40b0-9550-75512d11da7b tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:40.201818 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-c861c622-b26b-40b0-9550-75512d11da7b tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:40.205039 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-05b0a3bd-d857-477b-8e6b-6e8d8058f6a5 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b581fa25045cea9585ae4e707585d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5319fd2dee9b4b47b98f59bca1572ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:19:40.216437 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-05b0a3bd-d857-477b-8e6b-6e8d8058f6a5 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] 10.222.0.66 "GET /compute/v2.1/servers/09a121f0-f7e5-4376-96bf-7008344dfe06" status: 200 len: 1318 microversion: 2.1 time: 0.265953 Nov 22 12:19:40.232138 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 53/94] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:19:39 2021] GET /compute/v2.1/servers/09a121f0-f7e5-4376-96bf-7008344dfe06 => generated 1318 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:19:40.294176 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-0b9633e4-35a8-4bfc-9f7e-6afc3779ea1b tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:19:40.294974 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-0b9633e4-35a8-4bfc-9f7e-6afc3779ea1b tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] [instance: 937d4958-6710-4c44-8451-2b659b87dc63] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:19:40.304557 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-0b9633e4-35a8-4bfc-9f7e-6afc3779ea1b tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:40.305011 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-0b9633e4-35a8-4bfc-9f7e-6afc3779ea1b tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:40.305962 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-0b9633e4-35a8-4bfc-9f7e-6afc3779ea1b tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:40.306679 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-0b9633e4-35a8-4bfc-9f7e-6afc3779ea1b tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:40.309061 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-c861c622-b26b-40b0-9550-75512d11da7b tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:19:40.319856 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-c861c622-b26b-40b0-9550-75512d11da7b tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:19:40.327446 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-c861c622-b26b-40b0-9550-75512d11da7b tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:19:40.329548 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-c861c622-b26b-40b0-9550-75512d11da7b tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff" status: 200 len: 1351 microversion: 2.20 time: 0.147732 Nov 22 12:19:40.332573 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 42/95] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Nov 22 12:19:40 2021] GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff => generated 1351 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 12:19:40.465444 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-0b9633e4-35a8-4bfc-9f7e-6afc3779ea1b tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1efac6c215148ce8c3ecdce1e9a8742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d392a7d77f46fcb4faa017786796fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:19:40.473599 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-0b9633e4-35a8-4bfc-9f7e-6afc3779ea1b tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] 10.222.0.66 "GET /compute/v2.1/servers/937d4958-6710-4c44-8451-2b659b87dc63" status: 200 len: 1321 microversion: 2.1 time: 0.184155 Nov 22 12:19:40.474455 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 54/96] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:19:40 2021] GET /compute/v2.1/servers/937d4958-6710-4c44-8451-2b659b87dc63 => generated 1321 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:19:40.819762 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [req-487e7371-d3dc-4b37-9065-d5bc824e60ee req-a616f1ad-3eac-4dc8-ab05-fe15eb5a6f9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09a121f0-f7e5-4376-96bf-7008344dfe06", "name": "network-vif-plugged", "status": "completed", "tag": "c07cfd45-5b74-4945-9991-863824fb50f3"}]} {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:19:40.830151 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 12:19:40.830151 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: warnings.warn(msg) Nov 22 12:19:40.843939 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [req-487e7371-d3dc-4b37-9065-d5bc824e60ee req-a616f1ad-3eac-4dc8-ab05-fe15eb5a6f9f service nova] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:40.844649 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [req-487e7371-d3dc-4b37-9065-d5bc824e60ee req-a616f1ad-3eac-4dc8-ab05-fe15eb5a6f9f service nova] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:40.855711 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-4e9f8398-f141-4cd9-87d1-35186563ce95 tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:19:40.856389 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-4e9f8398-f141-4cd9-87d1-35186563ce95 tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] [instance: 0e1fe798-845f-4f01-b699-0e2fac35e5c3] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:19:40.863520 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.compute.server_external_events [req-487e7371-d3dc-4b37-9065-d5bc824e60ee req-a616f1ad-3eac-4dc8-ab05-fe15eb5a6f9f service nova] Creating event network-vif-plugged:c07cfd45-5b74-4945-9991-863824fb50f3 for instance 09a121f0-f7e5-4376-96bf-7008344dfe06 on hv-cinder-76845 Nov 22 12:19:40.871733 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-4e9f8398-f141-4cd9-87d1-35186563ce95 tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:40.872525 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [req-487e7371-d3dc-4b37-9065-d5bc824e60ee req-a616f1ad-3eac-4dc8-ab05-fe15eb5a6f9f service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059649 Nov 22 12:19:40.873177 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-4e9f8398-f141-4cd9-87d1-35186563ce95 tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:40.873878 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 43/97] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Nov 22 12:19:40 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 22 12:19:40.876149 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-4e9f8398-f141-4cd9-87d1-35186563ce95 tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:40.876868 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-4e9f8398-f141-4cd9-87d1-35186563ce95 tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:41.055187 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-4e9f8398-f141-4cd9-87d1-35186563ce95 tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3127e81d7664dbbbce53d6d7f2bae4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c32f9960704ce6b26019efdc2abddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:19:41.063345 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-4e9f8398-f141-4cd9-87d1-35186563ce95 tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] 10.222.0.66 "GET /compute/v2.1/servers/0e1fe798-845f-4f01-b699-0e2fac35e5c3" status: 200 len: 1315 microversion: 2.1 time: 0.213137 Nov 22 12:19:41.067860 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 55/98] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:19:40 2021] GET /compute/v2.1/servers/0e1fe798-845f-4f01-b699-0e2fac35e5c3 => generated 1315 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:19:41.239998 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-aceefb2f-e5d1-4e05-aa08-2d54a1d47dc8 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:19:41.241213 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-aceefb2f-e5d1-4e05-aa08-2d54a1d47dc8 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] [instance: 09a121f0-f7e5-4376-96bf-7008344dfe06] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:19:41.248416 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-aceefb2f-e5d1-4e05-aa08-2d54a1d47dc8 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:41.249058 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-aceefb2f-e5d1-4e05-aa08-2d54a1d47dc8 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:41.250028 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-aceefb2f-e5d1-4e05-aa08-2d54a1d47dc8 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:41.250656 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-aceefb2f-e5d1-4e05-aa08-2d54a1d47dc8 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:41.349210 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-ce70cc63-6642-41fc-a58a-a7c187c0fc4d tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:19:41.349904 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-ce70cc63-6642-41fc-a58a-a7c187c0fc4d tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: c9f6d441-246f-479e-8e88-ea701c0f87ff] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:19:41.356805 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-ce70cc63-6642-41fc-a58a-a7c187c0fc4d tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:41.357286 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-ce70cc63-6642-41fc-a58a-a7c187c0fc4d tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:41.358073 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-ce70cc63-6642-41fc-a58a-a7c187c0fc4d tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:41.358503 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-ce70cc63-6642-41fc-a58a-a7c187c0fc4d tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:41.421086 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-aceefb2f-e5d1-4e05-aa08-2d54a1d47dc8 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b581fa25045cea9585ae4e707585d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5319fd2dee9b4b47b98f59bca1572ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:19:41.428508 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-aceefb2f-e5d1-4e05-aa08-2d54a1d47dc8 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] 10.222.0.66 "GET /compute/v2.1/servers/09a121f0-f7e5-4376-96bf-7008344dfe06" status: 200 len: 1318 microversion: 2.1 time: 0.192789 Nov 22 12:19:41.438297 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-ce70cc63-6642-41fc-a58a-a7c187c0fc4d tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:19:41.439023 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 44/99] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:19:41 2021] GET /compute/v2.1/servers/09a121f0-f7e5-4376-96bf-7008344dfe06 => generated 1318 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:19:41.445840 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-ce70cc63-6642-41fc-a58a-a7c187c0fc4d tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:19:41.447708 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-ce70cc63-6642-41fc-a58a-a7c187c0fc4d tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:19:41.449000 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-ce70cc63-6642-41fc-a58a-a7c187c0fc4d tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff" status: 200 len: 1351 microversion: 2.20 time: 0.104307 Nov 22 12:19:41.450115 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 56/100] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Nov 22 12:19:41 2021] GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff => generated 1351 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 22 12:19:41.492960 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-f55eb7da-4618-4db1-8a99-1c623f15e94c tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:19:41.493650 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-f55eb7da-4618-4db1-8a99-1c623f15e94c tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] [instance: 937d4958-6710-4c44-8451-2b659b87dc63] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:19:41.501168 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-f55eb7da-4618-4db1-8a99-1c623f15e94c tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:41.501901 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-f55eb7da-4618-4db1-8a99-1c623f15e94c tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:41.503183 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-f55eb7da-4618-4db1-8a99-1c623f15e94c tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:41.503967 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-f55eb7da-4618-4db1-8a99-1c623f15e94c tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:41.673060 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-f55eb7da-4618-4db1-8a99-1c623f15e94c tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1efac6c215148ce8c3ecdce1e9a8742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d392a7d77f46fcb4faa017786796fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:19:41.680917 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-f55eb7da-4618-4db1-8a99-1c623f15e94c tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] 10.222.0.66 "GET /compute/v2.1/servers/937d4958-6710-4c44-8451-2b659b87dc63" status: 200 len: 1321 microversion: 2.1 time: 0.192687 Nov 22 12:19:41.681493 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 45/101] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:19:41 2021] GET /compute/v2.1/servers/937d4958-6710-4c44-8451-2b659b87dc63 => generated 1321 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:19:42.088414 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-db2eddd0-d3a8-4810-8bd5-3301f433f087 tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:19:42.090028 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-db2eddd0-d3a8-4810-8bd5-3301f433f087 tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] [instance: 0e1fe798-845f-4f01-b699-0e2fac35e5c3] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:19:42.111636 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-db2eddd0-d3a8-4810-8bd5-3301f433f087 tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:42.114052 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-db2eddd0-d3a8-4810-8bd5-3301f433f087 tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:42.122569 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-db2eddd0-d3a8-4810-8bd5-3301f433f087 tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:42.123329 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-db2eddd0-d3a8-4810-8bd5-3301f433f087 tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:42.380111 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-db2eddd0-d3a8-4810-8bd5-3301f433f087 tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3127e81d7664dbbbce53d6d7f2bae4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c32f9960704ce6b26019efdc2abddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:19:42.387077 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-db2eddd0-d3a8-4810-8bd5-3301f433f087 tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] 10.222.0.66 "GET /compute/v2.1/servers/0e1fe798-845f-4f01-b699-0e2fac35e5c3" status: 200 len: 1315 microversion: 2.1 time: 0.304144 Nov 22 12:19:42.390388 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 57/102] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:19:42 2021] GET /compute/v2.1/servers/0e1fe798-845f-4f01-b699-0e2fac35e5c3 => generated 1315 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:19:42.446106 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-714eab29-5313-4d4b-81ee-70179291de3f tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:19:42.446716 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-714eab29-5313-4d4b-81ee-70179291de3f tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] [instance: 09a121f0-f7e5-4376-96bf-7008344dfe06] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:19:42.456320 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-714eab29-5313-4d4b-81ee-70179291de3f tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:42.458860 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-714eab29-5313-4d4b-81ee-70179291de3f tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:42.461406 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-714eab29-5313-4d4b-81ee-70179291de3f tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:42.467741 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-848331e3-16d6-4540-ac47-2e6b201acf3f tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:19:42.468526 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-848331e3-16d6-4540-ac47-2e6b201acf3f tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: c9f6d441-246f-479e-8e88-ea701c0f87ff] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:19:42.471868 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-714eab29-5313-4d4b-81ee-70179291de3f tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:42.477469 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-848331e3-16d6-4540-ac47-2e6b201acf3f tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:42.478344 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-848331e3-16d6-4540-ac47-2e6b201acf3f tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:42.480294 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-848331e3-16d6-4540-ac47-2e6b201acf3f tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:42.481179 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-848331e3-16d6-4540-ac47-2e6b201acf3f tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:42.589861 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-848331e3-16d6-4540-ac47-2e6b201acf3f tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:19:42.600721 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-848331e3-16d6-4540-ac47-2e6b201acf3f tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:19:42.602418 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-848331e3-16d6-4540-ac47-2e6b201acf3f tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:19:42.604060 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-848331e3-16d6-4540-ac47-2e6b201acf3f tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff" status: 200 len: 1339 microversion: 2.20 time: 0.141221 Nov 22 12:19:42.607273 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 58/103] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Nov 22 12:19:42 2021] GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff => generated 1339 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 12:19:42.699498 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-84d1a6fe-682b-4bda-a44b-b6fce461c0d1 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:19:42.700551 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-84d1a6fe-682b-4bda-a44b-b6fce461c0d1 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] [instance: 937d4958-6710-4c44-8451-2b659b87dc63] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:19:42.710153 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-84d1a6fe-682b-4bda-a44b-b6fce461c0d1 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:42.714385 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-84d1a6fe-682b-4bda-a44b-b6fce461c0d1 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:42.715789 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-84d1a6fe-682b-4bda-a44b-b6fce461c0d1 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:42.719958 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-84d1a6fe-682b-4bda-a44b-b6fce461c0d1 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:42.751815 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-714eab29-5313-4d4b-81ee-70179291de3f tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b581fa25045cea9585ae4e707585d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5319fd2dee9b4b47b98f59bca1572ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:19:42.760389 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-714eab29-5313-4d4b-81ee-70179291de3f tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] 10.222.0.66 "GET /compute/v2.1/servers/09a121f0-f7e5-4376-96bf-7008344dfe06" status: 200 len: 1318 microversion: 2.1 time: 0.318755 Nov 22 12:19:42.761137 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 46/104] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:19:42 2021] GET /compute/v2.1/servers/09a121f0-f7e5-4376-96bf-7008344dfe06 => generated 1318 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:19:42.905054 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-84d1a6fe-682b-4bda-a44b-b6fce461c0d1 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1efac6c215148ce8c3ecdce1e9a8742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d392a7d77f46fcb4faa017786796fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:19:42.913788 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-84d1a6fe-682b-4bda-a44b-b6fce461c0d1 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] 10.222.0.66 "GET /compute/v2.1/servers/937d4958-6710-4c44-8451-2b659b87dc63" status: 200 len: 1321 microversion: 2.1 time: 0.219216 Nov 22 12:19:42.914539 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 59/105] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:19:42 2021] GET /compute/v2.1/servers/937d4958-6710-4c44-8451-2b659b87dc63 => generated 1321 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:19:43.409702 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-003882f7-932e-410b-a576-b9c443949a8c tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:19:43.410347 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-003882f7-932e-410b-a576-b9c443949a8c tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] [instance: 0e1fe798-845f-4f01-b699-0e2fac35e5c3] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:19:43.417918 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-003882f7-932e-410b-a576-b9c443949a8c tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:43.418393 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-003882f7-932e-410b-a576-b9c443949a8c tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:43.419392 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-003882f7-932e-410b-a576-b9c443949a8c tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:43.419823 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-003882f7-932e-410b-a576-b9c443949a8c tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:43.562096 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-003882f7-932e-410b-a576-b9c443949a8c tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3127e81d7664dbbbce53d6d7f2bae4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c32f9960704ce6b26019efdc2abddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:19:43.569765 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-003882f7-932e-410b-a576-b9c443949a8c tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] 10.222.0.66 "GET /compute/v2.1/servers/0e1fe798-845f-4f01-b699-0e2fac35e5c3" status: 200 len: 1315 microversion: 2.1 time: 0.164107 Nov 22 12:19:43.570576 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 47/106] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:19:43 2021] GET /compute/v2.1/servers/0e1fe798-845f-4f01-b699-0e2fac35e5c3 => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:19:43.622818 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-cd83940b-012e-4060-a24c-5b7ac49044c6 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:19:43.623494 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-cd83940b-012e-4060-a24c-5b7ac49044c6 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: c9f6d441-246f-479e-8e88-ea701c0f87ff] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:19:43.629698 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-cd83940b-012e-4060-a24c-5b7ac49044c6 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:43.630140 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-cd83940b-012e-4060-a24c-5b7ac49044c6 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:43.630920 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-cd83940b-012e-4060-a24c-5b7ac49044c6 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:43.631363 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-cd83940b-012e-4060-a24c-5b7ac49044c6 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:43.689968 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-cd83940b-012e-4060-a24c-5b7ac49044c6 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:19:43.699553 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-cd83940b-012e-4060-a24c-5b7ac49044c6 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:19:43.701749 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-cd83940b-012e-4060-a24c-5b7ac49044c6 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:19:43.703151 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-cd83940b-012e-4060-a24c-5b7ac49044c6 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff" status: 200 len: 1339 microversion: 2.20 time: 0.084630 Nov 22 12:19:43.703764 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 60/107] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Nov 22 12:19:43 2021] GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff => generated 1339 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 12:19:43.777581 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-38c24948-6fcb-4f3e-892a-f827524976d3 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:19:43.778217 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-38c24948-6fcb-4f3e-892a-f827524976d3 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] [instance: 09a121f0-f7e5-4376-96bf-7008344dfe06] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:19:43.784637 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-38c24948-6fcb-4f3e-892a-f827524976d3 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:43.785183 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-38c24948-6fcb-4f3e-892a-f827524976d3 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:43.786047 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-38c24948-6fcb-4f3e-892a-f827524976d3 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:43.786560 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-38c24948-6fcb-4f3e-892a-f827524976d3 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:43.922772 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-38c24948-6fcb-4f3e-892a-f827524976d3 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b581fa25045cea9585ae4e707585d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5319fd2dee9b4b47b98f59bca1572ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:19:43.929698 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-98ef3aec-ef16-42f8-b0ea-934d6dd3e405 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:19:43.930302 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-98ef3aec-ef16-42f8-b0ea-934d6dd3e405 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] [instance: 937d4958-6710-4c44-8451-2b659b87dc63] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:19:43.930403 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-38c24948-6fcb-4f3e-892a-f827524976d3 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] 10.222.0.66 "GET /compute/v2.1/servers/09a121f0-f7e5-4376-96bf-7008344dfe06" status: 200 len: 1318 microversion: 2.1 time: 0.156786 Nov 22 12:19:43.930917 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 48/108] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:19:43 2021] GET /compute/v2.1/servers/09a121f0-f7e5-4376-96bf-7008344dfe06 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:19:43.937081 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-98ef3aec-ef16-42f8-b0ea-934d6dd3e405 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:43.937526 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-98ef3aec-ef16-42f8-b0ea-934d6dd3e405 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:43.938300 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-98ef3aec-ef16-42f8-b0ea-934d6dd3e405 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:43.938934 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-98ef3aec-ef16-42f8-b0ea-934d6dd3e405 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:44.075610 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-98ef3aec-ef16-42f8-b0ea-934d6dd3e405 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1efac6c215148ce8c3ecdce1e9a8742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d392a7d77f46fcb4faa017786796fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:19:44.084090 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-98ef3aec-ef16-42f8-b0ea-934d6dd3e405 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] 10.222.0.66 "GET /compute/v2.1/servers/937d4958-6710-4c44-8451-2b659b87dc63" status: 200 len: 1321 microversion: 2.1 time: 0.157872 Nov 22 12:19:44.085041 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 61/109] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:19:43 2021] GET /compute/v2.1/servers/937d4958-6710-4c44-8451-2b659b87dc63 => generated 1321 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 12:19:44.586958 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-cc4fb476-671a-4341-8ef4-9deec0e0eadb tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:19:44.587651 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-cc4fb476-671a-4341-8ef4-9deec0e0eadb tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] [instance: 0e1fe798-845f-4f01-b699-0e2fac35e5c3] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:19:44.594649 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-cc4fb476-671a-4341-8ef4-9deec0e0eadb tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:44.595102 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-cc4fb476-671a-4341-8ef4-9deec0e0eadb tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:44.595924 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-cc4fb476-671a-4341-8ef4-9deec0e0eadb tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:44.596352 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-cc4fb476-671a-4341-8ef4-9deec0e0eadb tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:44.722001 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-0e180a23-8394-4229-9aa5-8c63c13b1269 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:19:44.722572 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-0e180a23-8394-4229-9aa5-8c63c13b1269 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: c9f6d441-246f-479e-8e88-ea701c0f87ff] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:19:44.728932 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-cc4fb476-671a-4341-8ef4-9deec0e0eadb tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3127e81d7664dbbbce53d6d7f2bae4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c32f9960704ce6b26019efdc2abddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:19:44.730965 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-0e180a23-8394-4229-9aa5-8c63c13b1269 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:44.731496 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-0e180a23-8394-4229-9aa5-8c63c13b1269 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:44.732464 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-0e180a23-8394-4229-9aa5-8c63c13b1269 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:44.732899 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-0e180a23-8394-4229-9aa5-8c63c13b1269 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:44.736930 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-cc4fb476-671a-4341-8ef4-9deec0e0eadb tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] 10.222.0.66 "GET /compute/v2.1/servers/0e1fe798-845f-4f01-b699-0e2fac35e5c3" status: 200 len: 1315 microversion: 2.1 time: 0.153618 Nov 22 12:19:44.737515 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 49/110] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:19:44 2021] GET /compute/v2.1/servers/0e1fe798-845f-4f01-b699-0e2fac35e5c3 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:19:44.799940 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-0e180a23-8394-4229-9aa5-8c63c13b1269 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:19:44.808342 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-0e180a23-8394-4229-9aa5-8c63c13b1269 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:19:44.809837 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-0e180a23-8394-4229-9aa5-8c63c13b1269 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:19:44.810923 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-0e180a23-8394-4229-9aa5-8c63c13b1269 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff" status: 200 len: 1339 microversion: 2.20 time: 0.092724 Nov 22 12:19:44.811521 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 62/111] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Nov 22 12:19:44 2021] GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff => generated 1339 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 12:19:44.950120 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-846456a4-bb58-4173-88a1-0cd6f4c4213c tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:19:44.950721 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-846456a4-bb58-4173-88a1-0cd6f4c4213c tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] [instance: 09a121f0-f7e5-4376-96bf-7008344dfe06] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:19:44.957329 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-846456a4-bb58-4173-88a1-0cd6f4c4213c tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:44.957771 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-846456a4-bb58-4173-88a1-0cd6f4c4213c tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:44.958578 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-846456a4-bb58-4173-88a1-0cd6f4c4213c tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:44.959000 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-846456a4-bb58-4173-88a1-0cd6f4c4213c tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:45.102784 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-1d97e3e6-83f9-4998-aba4-4bb9e9dfe920 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:19:45.103161 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-1d97e3e6-83f9-4998-aba4-4bb9e9dfe920 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] [instance: 937d4958-6710-4c44-8451-2b659b87dc63] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:19:45.112306 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-1d97e3e6-83f9-4998-aba4-4bb9e9dfe920 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:45.112924 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-1d97e3e6-83f9-4998-aba4-4bb9e9dfe920 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:45.116232 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-846456a4-bb58-4173-88a1-0cd6f4c4213c tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b581fa25045cea9585ae4e707585d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5319fd2dee9b4b47b98f59bca1572ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:19:45.125017 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-846456a4-bb58-4173-88a1-0cd6f4c4213c tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] 10.222.0.66 "GET /compute/v2.1/servers/09a121f0-f7e5-4376-96bf-7008344dfe06" status: 200 len: 1318 microversion: 2.1 time: 0.178814 Nov 22 12:19:45.125598 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 50/112] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:19:44 2021] GET /compute/v2.1/servers/09a121f0-f7e5-4376-96bf-7008344dfe06 => generated 1318 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:19:45.126248 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-1d97e3e6-83f9-4998-aba4-4bb9e9dfe920 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:45.127200 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-1d97e3e6-83f9-4998-aba4-4bb9e9dfe920 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:45.629861 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-1d97e3e6-83f9-4998-aba4-4bb9e9dfe920 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1efac6c215148ce8c3ecdce1e9a8742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d392a7d77f46fcb4faa017786796fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:19:45.638333 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-1d97e3e6-83f9-4998-aba4-4bb9e9dfe920 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] 10.222.0.66 "GET /compute/v2.1/servers/937d4958-6710-4c44-8451-2b659b87dc63" status: 200 len: 1321 microversion: 2.1 time: 0.540027 Nov 22 12:19:45.638921 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 63/113] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:19:45 2021] GET /compute/v2.1/servers/937d4958-6710-4c44-8451-2b659b87dc63 => generated 1321 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:19:45.758831 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-d2df41b9-8e26-41c8-b927-0af417bfd645 tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:19:45.760138 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-d2df41b9-8e26-41c8-b927-0af417bfd645 tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] [instance: 0e1fe798-845f-4f01-b699-0e2fac35e5c3] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:19:45.770429 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-d2df41b9-8e26-41c8-b927-0af417bfd645 tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:45.771251 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-d2df41b9-8e26-41c8-b927-0af417bfd645 tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:45.772628 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-d2df41b9-8e26-41c8-b927-0af417bfd645 tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:45.773388 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-d2df41b9-8e26-41c8-b927-0af417bfd645 tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:45.829743 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-27b7b52d-f6e3-4938-9b29-f4246a8dd96f tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:19:45.830401 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-27b7b52d-f6e3-4938-9b29-f4246a8dd96f tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: c9f6d441-246f-479e-8e88-ea701c0f87ff] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:19:45.837111 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-27b7b52d-f6e3-4938-9b29-f4246a8dd96f tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:45.837558 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-27b7b52d-f6e3-4938-9b29-f4246a8dd96f tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:45.838357 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-27b7b52d-f6e3-4938-9b29-f4246a8dd96f tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:45.838792 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-27b7b52d-f6e3-4938-9b29-f4246a8dd96f tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:45.943200 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-27b7b52d-f6e3-4938-9b29-f4246a8dd96f tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:19:45.957597 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-27b7b52d-f6e3-4938-9b29-f4246a8dd96f tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:19:45.959177 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-27b7b52d-f6e3-4938-9b29-f4246a8dd96f tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:19:45.960364 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-27b7b52d-f6e3-4938-9b29-f4246a8dd96f tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff" status: 200 len: 1339 microversion: 2.20 time: 0.134355 Nov 22 12:19:45.960910 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 64/114] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Nov 22 12:19:45 2021] GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff => generated 1339 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 12:19:46.060826 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-d2df41b9-8e26-41c8-b927-0af417bfd645 tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3127e81d7664dbbbce53d6d7f2bae4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c32f9960704ce6b26019efdc2abddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:19:46.071667 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-d2df41b9-8e26-41c8-b927-0af417bfd645 tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] 10.222.0.66 "GET /compute/v2.1/servers/0e1fe798-845f-4f01-b699-0e2fac35e5c3" status: 200 len: 1315 microversion: 2.1 time: 0.318960 Nov 22 12:19:46.072283 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 51/115] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:19:45 2021] GET /compute/v2.1/servers/0e1fe798-845f-4f01-b699-0e2fac35e5c3 => generated 1315 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:19:46.143287 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-70716fe3-6287-4035-9b41-36c31f9e9c3f tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:19:46.143952 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-70716fe3-6287-4035-9b41-36c31f9e9c3f tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] [instance: 09a121f0-f7e5-4376-96bf-7008344dfe06] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:19:46.150431 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-70716fe3-6287-4035-9b41-36c31f9e9c3f tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:46.151103 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-70716fe3-6287-4035-9b41-36c31f9e9c3f tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:46.152571 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-70716fe3-6287-4035-9b41-36c31f9e9c3f tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:46.153171 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-70716fe3-6287-4035-9b41-36c31f9e9c3f tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:46.352201 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-70716fe3-6287-4035-9b41-36c31f9e9c3f tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b581fa25045cea9585ae4e707585d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5319fd2dee9b4b47b98f59bca1572ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:19:46.359909 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-70716fe3-6287-4035-9b41-36c31f9e9c3f tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] 10.222.0.66 "GET /compute/v2.1/servers/09a121f0-f7e5-4376-96bf-7008344dfe06" status: 200 len: 1318 microversion: 2.1 time: 0.220282 Nov 22 12:19:46.360511 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 65/116] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:19:46 2021] GET /compute/v2.1/servers/09a121f0-f7e5-4376-96bf-7008344dfe06 => generated 1318 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:19:46.656382 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-4cfdddaa-7ea3-4c1e-9184-3484816106f7 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:19:46.656892 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-4cfdddaa-7ea3-4c1e-9184-3484816106f7 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] [instance: 937d4958-6710-4c44-8451-2b659b87dc63] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:19:46.663733 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-4cfdddaa-7ea3-4c1e-9184-3484816106f7 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:46.664181 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-4cfdddaa-7ea3-4c1e-9184-3484816106f7 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:46.664960 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-4cfdddaa-7ea3-4c1e-9184-3484816106f7 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:46.665393 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-4cfdddaa-7ea3-4c1e-9184-3484816106f7 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:46.810855 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-4cfdddaa-7ea3-4c1e-9184-3484816106f7 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1efac6c215148ce8c3ecdce1e9a8742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d392a7d77f46fcb4faa017786796fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:19:46.819053 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-4cfdddaa-7ea3-4c1e-9184-3484816106f7 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] 10.222.0.66 "GET /compute/v2.1/servers/937d4958-6710-4c44-8451-2b659b87dc63" status: 200 len: 1321 microversion: 2.1 time: 0.166698 Nov 22 12:19:46.819651 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 52/117] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:19:46 2021] GET /compute/v2.1/servers/937d4958-6710-4c44-8451-2b659b87dc63 => generated 1321 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:19:46.981181 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-52a5cd82-d4bd-43c0-84a8-41327150f076 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:19:46.981723 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-52a5cd82-d4bd-43c0-84a8-41327150f076 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: c9f6d441-246f-479e-8e88-ea701c0f87ff] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:19:46.988196 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-52a5cd82-d4bd-43c0-84a8-41327150f076 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:46.988648 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-52a5cd82-d4bd-43c0-84a8-41327150f076 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:46.989423 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-52a5cd82-d4bd-43c0-84a8-41327150f076 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:46.989854 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-52a5cd82-d4bd-43c0-84a8-41327150f076 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:47.089998 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-a5a08622-1635-4f00-8ba0-7b6a41c94c6e tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:19:47.090701 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-a5a08622-1635-4f00-8ba0-7b6a41c94c6e tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] [instance: 0e1fe798-845f-4f01-b699-0e2fac35e5c3] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:19:47.097882 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-a5a08622-1635-4f00-8ba0-7b6a41c94c6e tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:47.098501 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-a5a08622-1635-4f00-8ba0-7b6a41c94c6e tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:47.099487 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-a5a08622-1635-4f00-8ba0-7b6a41c94c6e tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:47.100003 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-a5a08622-1635-4f00-8ba0-7b6a41c94c6e tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:47.133552 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-52a5cd82-d4bd-43c0-84a8-41327150f076 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:19:47.142329 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-52a5cd82-d4bd-43c0-84a8-41327150f076 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:19:47.143848 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-52a5cd82-d4bd-43c0-84a8-41327150f076 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:19:47.144964 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-52a5cd82-d4bd-43c0-84a8-41327150f076 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff" status: 200 len: 1407 microversion: 2.20 time: 0.169976 Nov 22 12:19:47.145505 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 66/118] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Nov 22 12:19:46 2021] GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff => generated 1407 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 12:19:47.234547 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-a5a08622-1635-4f00-8ba0-7b6a41c94c6e tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3127e81d7664dbbbce53d6d7f2bae4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c32f9960704ce6b26019efdc2abddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:19:47.242005 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-a5a08622-1635-4f00-8ba0-7b6a41c94c6e tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] 10.222.0.66 "GET /compute/v2.1/servers/0e1fe798-845f-4f01-b699-0e2fac35e5c3" status: 200 len: 1315 microversion: 2.1 time: 0.156069 Nov 22 12:19:47.242581 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 53/119] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:19:47 2021] GET /compute/v2.1/servers/0e1fe798-845f-4f01-b699-0e2fac35e5c3 => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:19:47.377193 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-505c9fef-5492-4b55-b885-1725b9d90485 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:19:47.377799 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-505c9fef-5492-4b55-b885-1725b9d90485 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] [instance: 09a121f0-f7e5-4376-96bf-7008344dfe06] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:19:47.384028 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-505c9fef-5492-4b55-b885-1725b9d90485 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:47.384475 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-505c9fef-5492-4b55-b885-1725b9d90485 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:47.385247 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-505c9fef-5492-4b55-b885-1725b9d90485 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:47.385679 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-505c9fef-5492-4b55-b885-1725b9d90485 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:47.525988 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-505c9fef-5492-4b55-b885-1725b9d90485 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b581fa25045cea9585ae4e707585d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5319fd2dee9b4b47b98f59bca1572ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:19:47.534004 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-505c9fef-5492-4b55-b885-1725b9d90485 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] 10.222.0.66 "GET /compute/v2.1/servers/09a121f0-f7e5-4376-96bf-7008344dfe06" status: 200 len: 1318 microversion: 2.1 time: 0.160123 Nov 22 12:19:47.534586 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 67/120] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:19:47 2021] GET /compute/v2.1/servers/09a121f0-f7e5-4376-96bf-7008344dfe06 => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:19:47.836364 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-699f78dd-7127-4708-9393-06f50e7ee2ff tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:19:47.836899 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-699f78dd-7127-4708-9393-06f50e7ee2ff tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] [instance: 937d4958-6710-4c44-8451-2b659b87dc63] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:19:47.843801 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-699f78dd-7127-4708-9393-06f50e7ee2ff tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:47.844253 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-699f78dd-7127-4708-9393-06f50e7ee2ff tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:47.845028 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-699f78dd-7127-4708-9393-06f50e7ee2ff tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:47.845460 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-699f78dd-7127-4708-9393-06f50e7ee2ff tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:48.000536 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-699f78dd-7127-4708-9393-06f50e7ee2ff tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1efac6c215148ce8c3ecdce1e9a8742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d392a7d77f46fcb4faa017786796fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:19:48.011480 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-699f78dd-7127-4708-9393-06f50e7ee2ff tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] 10.222.0.66 "GET /compute/v2.1/servers/937d4958-6710-4c44-8451-2b659b87dc63" status: 200 len: 1321 microversion: 2.1 time: 0.178563 Nov 22 12:19:48.012069 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 54/121] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:19:47 2021] GET /compute/v2.1/servers/937d4958-6710-4c44-8451-2b659b87dc63 => generated 1321 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:19:48.162976 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-a0c9ee43-791c-46a3-b056-a957b12af220 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:19:48.163553 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-a0c9ee43-791c-46a3-b056-a957b12af220 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: c9f6d441-246f-479e-8e88-ea701c0f87ff] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:19:48.170287 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-a0c9ee43-791c-46a3-b056-a957b12af220 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:48.170735 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-a0c9ee43-791c-46a3-b056-a957b12af220 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:48.171549 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-a0c9ee43-791c-46a3-b056-a957b12af220 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:48.171983 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-a0c9ee43-791c-46a3-b056-a957b12af220 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:48.258946 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-d9db8a72-8696-4270-a88f-ff22bfe44228 tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:19:48.259557 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-d9db8a72-8696-4270-a88f-ff22bfe44228 tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] [instance: 0e1fe798-845f-4f01-b699-0e2fac35e5c3] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:19:48.265870 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-d9db8a72-8696-4270-a88f-ff22bfe44228 tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:48.266320 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-d9db8a72-8696-4270-a88f-ff22bfe44228 tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:48.267313 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-d9db8a72-8696-4270-a88f-ff22bfe44228 tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:48.267761 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-d9db8a72-8696-4270-a88f-ff22bfe44228 tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:48.310601 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-a0c9ee43-791c-46a3-b056-a957b12af220 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:19:48.326254 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-a0c9ee43-791c-46a3-b056-a957b12af220 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:19:48.328864 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-a0c9ee43-791c-46a3-b056-a957b12af220 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:19:48.330882 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-a0c9ee43-791c-46a3-b056-a957b12af220 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff" status: 200 len: 1407 microversion: 2.20 time: 0.171937 Nov 22 12:19:48.331491 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 68/122] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Nov 22 12:19:48 2021] GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff => generated 1407 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 12:19:48.431770 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-d9db8a72-8696-4270-a88f-ff22bfe44228 tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3127e81d7664dbbbce53d6d7f2bae4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c32f9960704ce6b26019efdc2abddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:19:48.443399 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-d9db8a72-8696-4270-a88f-ff22bfe44228 tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] 10.222.0.66 "GET /compute/v2.1/servers/0e1fe798-845f-4f01-b699-0e2fac35e5c3" status: 200 len: 1315 microversion: 2.1 time: 0.187768 Nov 22 12:19:48.444151 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 55/123] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:19:48 2021] GET /compute/v2.1/servers/0e1fe798-845f-4f01-b699-0e2fac35e5c3 => generated 1315 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:19:48.555432 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-9e60ea50-e501-4736-a1ff-a03a98ff7efb tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:19:48.556250 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-9e60ea50-e501-4736-a1ff-a03a98ff7efb tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] [instance: 09a121f0-f7e5-4376-96bf-7008344dfe06] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:19:48.563399 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-9e60ea50-e501-4736-a1ff-a03a98ff7efb tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:48.564289 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-9e60ea50-e501-4736-a1ff-a03a98ff7efb tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:48.565381 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-9e60ea50-e501-4736-a1ff-a03a98ff7efb tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:48.565695 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-9e60ea50-e501-4736-a1ff-a03a98ff7efb tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:48.833175 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-9e60ea50-e501-4736-a1ff-a03a98ff7efb tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b581fa25045cea9585ae4e707585d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5319fd2dee9b4b47b98f59bca1572ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:19:48.841560 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-9e60ea50-e501-4736-a1ff-a03a98ff7efb tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] 10.222.0.66 "GET /compute/v2.1/servers/09a121f0-f7e5-4376-96bf-7008344dfe06" status: 200 len: 1318 microversion: 2.1 time: 0.289907 Nov 22 12:19:48.842150 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 69/124] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:19:48 2021] GET /compute/v2.1/servers/09a121f0-f7e5-4376-96bf-7008344dfe06 => generated 1318 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:19:49.034792 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-a79bbb11-5583-4d9d-9a5b-ad59f730ebfe tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:19:49.036174 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-a79bbb11-5583-4d9d-9a5b-ad59f730ebfe tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] [instance: 937d4958-6710-4c44-8451-2b659b87dc63] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:19:49.043197 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-a79bbb11-5583-4d9d-9a5b-ad59f730ebfe tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:49.044202 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-a79bbb11-5583-4d9d-9a5b-ad59f730ebfe tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:49.045124 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-a79bbb11-5583-4d9d-9a5b-ad59f730ebfe tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:49.045656 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-a79bbb11-5583-4d9d-9a5b-ad59f730ebfe tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:49.102992 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [req-fbd99471-c2ed-40c6-9aa3-e75d1ee5a97f req-c420e345-3d98-47aa-a4b6-2bb3c2a0618f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "937d4958-6710-4c44-8451-2b659b87dc63", "name": "network-vif-plugged", "status": "completed", "tag": "4c9b376a-8f72-407b-9a92-78116503f6ab"}]} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:19:49.106310 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 12:19:49.106310 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: warnings.warn(msg) Nov 22 12:19:49.114108 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [req-fbd99471-c2ed-40c6-9aa3-e75d1ee5a97f req-c420e345-3d98-47aa-a4b6-2bb3c2a0618f service nova] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:49.114635 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [req-fbd99471-c2ed-40c6-9aa3-e75d1ee5a97f req-c420e345-3d98-47aa-a4b6-2bb3c2a0618f service nova] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:49.128298 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.compute.server_external_events [req-fbd99471-c2ed-40c6-9aa3-e75d1ee5a97f req-c420e345-3d98-47aa-a4b6-2bb3c2a0618f service nova] Creating event network-vif-plugged:4c9b376a-8f72-407b-9a92-78116503f6ab for instance 937d4958-6710-4c44-8451-2b659b87dc63 on hv-cinder-76845 Nov 22 12:19:49.136708 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [req-fbd99471-c2ed-40c6-9aa3-e75d1ee5a97f req-c420e345-3d98-47aa-a4b6-2bb3c2a0618f service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037993 Nov 22 12:19:49.138385 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 70/125] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Nov 22 12:19:49 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 12:19:49.211532 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [req-9654aafb-214d-4f98-be88-5f5535e6404b req-a785ddb4-72f1-4362-9f2b-2e789d0f9d82 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9f6d441-246f-479e-8e88-ea701c0f87ff", "tag": "c3893e14-5c03-4b6a-b17d-c2dc56e8e688"}]} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:19:49.213924 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 12:19:49.213924 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: warnings.warn(msg) Nov 22 12:19:49.236553 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [req-9654aafb-214d-4f98-be88-5f5535e6404b req-a785ddb4-72f1-4362-9f2b-2e789d0f9d82 service nova] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:49.237254 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [req-9654aafb-214d-4f98-be88-5f5535e6404b req-a785ddb4-72f1-4362-9f2b-2e789d0f9d82 service nova] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:49.258902 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.compute.server_external_events [req-9654aafb-214d-4f98-be88-5f5535e6404b req-a785ddb4-72f1-4362-9f2b-2e789d0f9d82 service nova] Creating event network-changed:c3893e14-5c03-4b6a-b17d-c2dc56e8e688 for instance c9f6d441-246f-479e-8e88-ea701c0f87ff on hv-cinder-76845 Nov 22 12:19:49.274920 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [req-9654aafb-214d-4f98-be88-5f5535e6404b req-a785ddb4-72f1-4362-9f2b-2e789d0f9d82 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062861 Nov 22 12:19:49.274920 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 71/126] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Nov 22 12:19:49 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 22 12:19:49.351684 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-f502ab26-50b1-4cfc-99a3-7f07a5fd8d19 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:19:49.352685 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-f502ab26-50b1-4cfc-99a3-7f07a5fd8d19 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: c9f6d441-246f-479e-8e88-ea701c0f87ff] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:19:49.361045 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-f502ab26-50b1-4cfc-99a3-7f07a5fd8d19 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:49.361666 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-f502ab26-50b1-4cfc-99a3-7f07a5fd8d19 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:49.362799 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-f502ab26-50b1-4cfc-99a3-7f07a5fd8d19 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:49.363436 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-f502ab26-50b1-4cfc-99a3-7f07a5fd8d19 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:49.364078 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-a79bbb11-5583-4d9d-9a5b-ad59f730ebfe tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1efac6c215148ce8c3ecdce1e9a8742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d392a7d77f46fcb4faa017786796fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:19:49.375397 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-a79bbb11-5583-4d9d-9a5b-ad59f730ebfe tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] 10.222.0.66 "GET /compute/v2.1/servers/937d4958-6710-4c44-8451-2b659b87dc63" status: 200 len: 1321 microversion: 2.1 time: 0.345249 Nov 22 12:19:49.381342 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 56/127] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:19:49 2021] GET /compute/v2.1/servers/937d4958-6710-4c44-8451-2b659b87dc63 => generated 1321 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:19:49.463435 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-3c8bd23c-4e00-42c9-a8c1-d12d5f5e1c27 tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:19:49.464155 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-3c8bd23c-4e00-42c9-a8c1-d12d5f5e1c27 tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] [instance: 0e1fe798-845f-4f01-b699-0e2fac35e5c3] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:19:49.472900 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-3c8bd23c-4e00-42c9-a8c1-d12d5f5e1c27 tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:49.475081 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-3c8bd23c-4e00-42c9-a8c1-d12d5f5e1c27 tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:49.476243 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-3c8bd23c-4e00-42c9-a8c1-d12d5f5e1c27 tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:49.478632 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-3c8bd23c-4e00-42c9-a8c1-d12d5f5e1c27 tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:49.743669 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-f502ab26-50b1-4cfc-99a3-7f07a5fd8d19 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:19:49.750342 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-3c8bd23c-4e00-42c9-a8c1-d12d5f5e1c27 tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3127e81d7664dbbbce53d6d7f2bae4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c32f9960704ce6b26019efdc2abddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:19:49.759346 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-3c8bd23c-4e00-42c9-a8c1-d12d5f5e1c27 tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] 10.222.0.66 "GET /compute/v2.1/servers/0e1fe798-845f-4f01-b699-0e2fac35e5c3" status: 200 len: 1315 microversion: 2.1 time: 0.302759 Nov 22 12:19:49.761695 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 57/128] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:19:49 2021] GET /compute/v2.1/servers/0e1fe798-845f-4f01-b699-0e2fac35e5c3 => generated 1315 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:19:49.773428 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-f502ab26-50b1-4cfc-99a3-7f07a5fd8d19 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:19:49.774917 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-f502ab26-50b1-4cfc-99a3-7f07a5fd8d19 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:19:49.776489 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-f502ab26-50b1-4cfc-99a3-7f07a5fd8d19 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff" status: 200 len: 1407 microversion: 2.20 time: 0.430473 Nov 22 12:19:49.777137 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 72/129] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Nov 22 12:19:49 2021] GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff => generated 1407 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 22 12:19:49.859833 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-400adaf0-5f2a-4831-ab5d-72d38ef644bb tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:19:49.860728 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-400adaf0-5f2a-4831-ab5d-72d38ef644bb tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] [instance: 09a121f0-f7e5-4376-96bf-7008344dfe06] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:19:49.870197 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-400adaf0-5f2a-4831-ab5d-72d38ef644bb tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:49.872051 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-400adaf0-5f2a-4831-ab5d-72d38ef644bb tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:49.873184 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-400adaf0-5f2a-4831-ab5d-72d38ef644bb tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:49.874487 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-400adaf0-5f2a-4831-ab5d-72d38ef644bb tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:50.378149 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-400adaf0-5f2a-4831-ab5d-72d38ef644bb tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b581fa25045cea9585ae4e707585d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5319fd2dee9b4b47b98f59bca1572ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:19:50.388030 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-400adaf0-5f2a-4831-ab5d-72d38ef644bb tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] 10.222.0.66 "GET /compute/v2.1/servers/09a121f0-f7e5-4376-96bf-7008344dfe06" status: 200 len: 1318 microversion: 2.1 time: 0.533574 Nov 22 12:19:50.388926 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 58/130] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:19:49 2021] GET /compute/v2.1/servers/09a121f0-f7e5-4376-96bf-7008344dfe06 => generated 1318 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:19:50.398091 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-5209df15-2705-48ec-ad65-4034da523dbc tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:19:50.398860 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-5209df15-2705-48ec-ad65-4034da523dbc tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] [instance: 937d4958-6710-4c44-8451-2b659b87dc63] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:19:50.405362 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-5209df15-2705-48ec-ad65-4034da523dbc tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:50.406136 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-5209df15-2705-48ec-ad65-4034da523dbc tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:50.407156 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-5209df15-2705-48ec-ad65-4034da523dbc tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:50.407795 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-5209df15-2705-48ec-ad65-4034da523dbc tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:50.635499 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-5209df15-2705-48ec-ad65-4034da523dbc tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1efac6c215148ce8c3ecdce1e9a8742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d392a7d77f46fcb4faa017786796fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:19:50.644014 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-5209df15-2705-48ec-ad65-4034da523dbc tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] 10.222.0.66 "GET /compute/v2.1/servers/937d4958-6710-4c44-8451-2b659b87dc63" status: 200 len: 1321 microversion: 2.1 time: 0.249656 Nov 22 12:19:50.644999 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 73/131] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:19:50 2021] GET /compute/v2.1/servers/937d4958-6710-4c44-8451-2b659b87dc63 => generated 1321 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:19:50.777677 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-189c6379-ac85-4246-a771-e4eef8b11953 tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:19:50.778655 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-189c6379-ac85-4246-a771-e4eef8b11953 tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] [instance: 0e1fe798-845f-4f01-b699-0e2fac35e5c3] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:19:50.790409 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-189c6379-ac85-4246-a771-e4eef8b11953 tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:50.790409 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-189c6379-ac85-4246-a771-e4eef8b11953 tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:50.791164 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-189c6379-ac85-4246-a771-e4eef8b11953 tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:50.791781 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-189c6379-ac85-4246-a771-e4eef8b11953 tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:50.798360 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-b1ef4a41-644f-4028-acb9-694a4002827d tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:19:50.798968 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-b1ef4a41-644f-4028-acb9-694a4002827d tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: c9f6d441-246f-479e-8e88-ea701c0f87ff] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:19:50.812545 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-b1ef4a41-644f-4028-acb9-694a4002827d tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:50.814808 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-b1ef4a41-644f-4028-acb9-694a4002827d tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:50.816314 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-b1ef4a41-644f-4028-acb9-694a4002827d tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:50.819888 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-b1ef4a41-644f-4028-acb9-694a4002827d tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:51.225540 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-189c6379-ac85-4246-a771-e4eef8b11953 tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3127e81d7664dbbbce53d6d7f2bae4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c32f9960704ce6b26019efdc2abddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:19:51.245672 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-189c6379-ac85-4246-a771-e4eef8b11953 tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] 10.222.0.66 "GET /compute/v2.1/servers/0e1fe798-845f-4f01-b699-0e2fac35e5c3" status: 200 len: 1503 microversion: 2.1 time: 0.472244 Nov 22 12:19:51.248667 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 59/132] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:19:50 2021] GET /compute/v2.1/servers/0e1fe798-845f-4f01-b699-0e2fac35e5c3 => generated 1503 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:19:51.332578 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [req-44dd503b-1150-4712-8123-8d8a0641e855 req-5d993704-9255-4cc0-aff5-55f45a481b79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "302ab8ef-5565-4f9b-9b91-b405d550a90d", "name": "network-vif-plugged", "status": "completed", "tag": "1fa9e48d-814b-49fa-b645-de1efce73a7d"}]} {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:19:51.334568 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 12:19:51.334568 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: warnings.warn(msg) Nov 22 12:19:51.354801 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-b1ef4a41-644f-4028-acb9-694a4002827d tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:19:51.355722 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [req-44dd503b-1150-4712-8123-8d8a0641e855 req-5d993704-9255-4cc0-aff5-55f45a481b79 service nova] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:51.356255 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [req-44dd503b-1150-4712-8123-8d8a0641e855 req-5d993704-9255-4cc0-aff5-55f45a481b79 service nova] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:51.372157 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-b1ef4a41-644f-4028-acb9-694a4002827d tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:19:51.374880 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-b1ef4a41-644f-4028-acb9-694a4002827d tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:19:51.382434 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-b1ef4a41-644f-4028-acb9-694a4002827d tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff" status: 200 len: 1407 microversion: 2.20 time: 0.586550 Nov 22 12:19:51.383898 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 74/133] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Nov 22 12:19:50 2021] GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff => generated 1407 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 12:19:51.389175 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.compute.server_external_events [req-44dd503b-1150-4712-8123-8d8a0641e855 req-5d993704-9255-4cc0-aff5-55f45a481b79 service nova] Creating event network-vif-plugged:1fa9e48d-814b-49fa-b645-de1efce73a7d for instance 302ab8ef-5565-4f9b-9b91-b405d550a90d on hv-cinder-76845 Nov 22 12:19:51.402493 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [req-44dd503b-1150-4712-8123-8d8a0641e855 req-5d993704-9255-4cc0-aff5-55f45a481b79 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073820 Nov 22 12:19:51.404822 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 60/134] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Nov 22 12:19:51 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 22 12:19:51.407329 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-8622ebe1-3613-483f-ad68-7955dc769fcd tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:19:51.409474 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-8622ebe1-3613-483f-ad68-7955dc769fcd tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] [instance: 09a121f0-f7e5-4376-96bf-7008344dfe06] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:19:51.439289 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-8622ebe1-3613-483f-ad68-7955dc769fcd tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:51.443203 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-8622ebe1-3613-483f-ad68-7955dc769fcd tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:51.445283 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-8622ebe1-3613-483f-ad68-7955dc769fcd tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:51.447308 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-8622ebe1-3613-483f-ad68-7955dc769fcd tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:51.662928 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-a0caf733-3992-4400-b02c-70b12f94e3d9 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:19:51.663917 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-a0caf733-3992-4400-b02c-70b12f94e3d9 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] [instance: 937d4958-6710-4c44-8451-2b659b87dc63] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:19:51.679783 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-a0caf733-3992-4400-b02c-70b12f94e3d9 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:51.683943 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-a0caf733-3992-4400-b02c-70b12f94e3d9 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:51.684806 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-a0caf733-3992-4400-b02c-70b12f94e3d9 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:51.685252 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-a0caf733-3992-4400-b02c-70b12f94e3d9 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:51.905265 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-8622ebe1-3613-483f-ad68-7955dc769fcd tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b581fa25045cea9585ae4e707585d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5319fd2dee9b4b47b98f59bca1572ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:19:51.913640 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-8622ebe1-3613-483f-ad68-7955dc769fcd tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] 10.222.0.66 "GET /compute/v2.1/servers/09a121f0-f7e5-4376-96bf-7008344dfe06" status: 200 len: 1508 microversion: 2.1 time: 0.511544 Nov 22 12:19:51.914664 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 75/135] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:19:51 2021] GET /compute/v2.1/servers/09a121f0-f7e5-4376-96bf-7008344dfe06 => generated 1508 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:19:52.119083 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-a0caf733-3992-4400-b02c-70b12f94e3d9 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1efac6c215148ce8c3ecdce1e9a8742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d392a7d77f46fcb4faa017786796fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:19:52.134793 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-a0caf733-3992-4400-b02c-70b12f94e3d9 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] 10.222.0.66 "GET /compute/v2.1/servers/937d4958-6710-4c44-8451-2b659b87dc63" status: 200 len: 1514 microversion: 2.1 time: 0.476881 Nov 22 12:19:52.146311 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 61/136] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:19:51 2021] GET /compute/v2.1/servers/937d4958-6710-4c44-8451-2b659b87dc63 => generated 1514 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:19:52.154977 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-940851fd-d7c9-4dd4-87d2-0edb1708b286 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:19:52.156186 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-940851fd-d7c9-4dd4-87d2-0edb1708b286 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] [instance: 937d4958-6710-4c44-8451-2b659b87dc63] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:19:52.171519 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-940851fd-d7c9-4dd4-87d2-0edb1708b286 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:52.172360 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-940851fd-d7c9-4dd4-87d2-0edb1708b286 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:52.173316 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-940851fd-d7c9-4dd4-87d2-0edb1708b286 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:52.173907 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-940851fd-d7c9-4dd4-87d2-0edb1708b286 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:52.284839 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.objects.instance [None req-940851fd-d7c9-4dd4-87d2-0edb1708b286 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lazy-loading 'flavor' on Instance uuid 937d4958-6710-4c44-8451-2b659b87dc63 {{(pid=116272) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 22 12:19:52.427725 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-9ed6a538-9be4-4136-a913-8c3a415084ed tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:19:52.429098 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-9ed6a538-9be4-4136-a913-8c3a415084ed tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: c9f6d441-246f-479e-8e88-ea701c0f87ff] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:19:52.436526 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-9ed6a538-9be4-4136-a913-8c3a415084ed tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:52.437326 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-9ed6a538-9be4-4136-a913-8c3a415084ed tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:52.438547 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-9ed6a538-9be4-4136-a913-8c3a415084ed tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:52.439351 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-9ed6a538-9be4-4136-a913-8c3a415084ed tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:52.510926 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-940851fd-d7c9-4dd4-87d2-0edb1708b286 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] 10.222.0.66 "POST /compute/v2.1/servers/937d4958-6710-4c44-8451-2b659b87dc63/action" status: 200 len: 32 microversion: 2.1 time: 0.360707 Nov 22 12:19:52.511771 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 76/137] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Nov 22 12:19:52 2021] POST /compute/v2.1/servers/937d4958-6710-4c44-8451-2b659b87dc63/action => generated 32 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 22 12:19:52.530632 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-18114fe7-1977-4be7-84a0-2d1e29f91148 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:19:52.534471 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-18114fe7-1977-4be7-84a0-2d1e29f91148 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] [instance: 937d4958-6710-4c44-8451-2b659b87dc63] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:19:52.550004 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-18114fe7-1977-4be7-84a0-2d1e29f91148 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:52.550610 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-18114fe7-1977-4be7-84a0-2d1e29f91148 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:52.551583 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-18114fe7-1977-4be7-84a0-2d1e29f91148 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:52.552083 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-18114fe7-1977-4be7-84a0-2d1e29f91148 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:52.794584 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-9ed6a538-9be4-4136-a913-8c3a415084ed tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:19:52.809775 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-9ed6a538-9be4-4136-a913-8c3a415084ed tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:19:52.815140 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-9ed6a538-9be4-4136-a913-8c3a415084ed tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:19:52.819890 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-9ed6a538-9be4-4136-a913-8c3a415084ed tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff" status: 200 len: 1407 microversion: 2.20 time: 0.420650 Nov 22 12:19:52.821155 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 62/138] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Nov 22 12:19:52 2021] GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff => generated 1407 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 22 12:19:52.933996 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-18114fe7-1977-4be7-84a0-2d1e29f91148 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1efac6c215148ce8c3ecdce1e9a8742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d392a7d77f46fcb4faa017786796fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:19:52.941114 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-71ba88a1-a792-4759-bcc6-53aeb9c4f420 tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a2eb4cc9-4412-4d37-9189-23034c8b245b"}} {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:19:52.942491 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-71ba88a1-a792-4759-bcc6-53aeb9c4f420 tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] [instance: 0e1fe798-845f-4f01-b699-0e2fac35e5c3] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:19:52.955776 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-18114fe7-1977-4be7-84a0-2d1e29f91148 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] 10.222.0.66 "GET /compute/v2.1/servers/937d4958-6710-4c44-8451-2b659b87dc63" status: 200 len: 1520 microversion: 2.1 time: 0.436503 Nov 22 12:19:52.956600 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 77/139] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:19:52 2021] GET /compute/v2.1/servers/937d4958-6710-4c44-8451-2b659b87dc63 => generated 1520 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:19:52.957943 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-71ba88a1-a792-4759-bcc6-53aeb9c4f420 tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:52.958617 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-71ba88a1-a792-4759-bcc6-53aeb9c4f420 tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:52.960072 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-71ba88a1-a792-4759-bcc6-53aeb9c4f420 tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:52.962058 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-71ba88a1-a792-4759-bcc6-53aeb9c4f420 tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:53.642352 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-71ba88a1-a792-4759-bcc6-53aeb9c4f420 tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] 10.222.0.66 "POST /compute/v2.1/servers/0e1fe798-845f-4f01-b699-0e2fac35e5c3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.712041 Nov 22 12:19:53.643070 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 63/140] 10.222.0.66 () {60 vars in 1322 bytes} [Mon Nov 22 12:19:52 2021] POST /compute/v2.1/servers/0e1fe798-845f-4f01-b699-0e2fac35e5c3/os-volume_attachments => generated 194 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 12:19:53.657342 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-5a90364c-57a4-4a98-b564-c656b34ee00c tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "81c31f27-cfdf-416d-9aab-f9591b037600"}} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:19:53.659411 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-5a90364c-57a4-4a98-b564-c656b34ee00c tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] [instance: 09a121f0-f7e5-4376-96bf-7008344dfe06] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:19:53.671658 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-5a90364c-57a4-4a98-b564-c656b34ee00c tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:53.672736 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-5a90364c-57a4-4a98-b564-c656b34ee00c tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:53.673723 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-5a90364c-57a4-4a98-b564-c656b34ee00c tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:53.674326 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-5a90364c-57a4-4a98-b564-c656b34ee00c tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:53.839797 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-80e2fca6-81df-4012-9994-57f607149c44 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:19:53.840513 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-80e2fca6-81df-4012-9994-57f607149c44 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: c9f6d441-246f-479e-8e88-ea701c0f87ff] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:19:53.851165 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-80e2fca6-81df-4012-9994-57f607149c44 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:53.851641 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-80e2fca6-81df-4012-9994-57f607149c44 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:53.859950 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-80e2fca6-81df-4012-9994-57f607149c44 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:53.864818 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-80e2fca6-81df-4012-9994-57f607149c44 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:54.118904 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-80e2fca6-81df-4012-9994-57f607149c44 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:19:54.129650 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-80e2fca6-81df-4012-9994-57f607149c44 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:19:54.131142 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-80e2fca6-81df-4012-9994-57f607149c44 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:19:54.133357 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-80e2fca6-81df-4012-9994-57f607149c44 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff" status: 200 len: 1407 microversion: 2.20 time: 0.298027 Nov 22 12:19:54.134140 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 64/141] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Nov 22 12:19:53 2021] GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff => generated 1407 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 12:19:54.142810 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-02c47842-6eb5-4fe4-a8ff-101d2cbe446b tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:19:54.143656 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-02c47842-6eb5-4fe4-a8ff-101d2cbe446b tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] [instance: 937d4958-6710-4c44-8451-2b659b87dc63] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:19:54.150851 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-02c47842-6eb5-4fe4-a8ff-101d2cbe446b tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:54.151038 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-02c47842-6eb5-4fe4-a8ff-101d2cbe446b tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:54.152998 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-02c47842-6eb5-4fe4-a8ff-101d2cbe446b tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:54.153595 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-02c47842-6eb5-4fe4-a8ff-101d2cbe446b tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:54.326072 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-02c47842-6eb5-4fe4-a8ff-101d2cbe446b tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1efac6c215148ce8c3ecdce1e9a8742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d392a7d77f46fcb4faa017786796fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:19:54.333901 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-02c47842-6eb5-4fe4-a8ff-101d2cbe446b tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] 10.222.0.66 "GET /compute/v2.1/servers/937d4958-6710-4c44-8451-2b659b87dc63" status: 200 len: 1520 microversion: 2.1 time: 0.198041 Nov 22 12:19:54.334515 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 65/142] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:19:54 2021] GET /compute/v2.1/servers/937d4958-6710-4c44-8451-2b659b87dc63 => generated 1520 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:19:54.702353 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-5a90364c-57a4-4a98-b564-c656b34ee00c tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] 10.222.0.66 "POST /compute/v2.1/servers/09a121f0-f7e5-4376-96bf-7008344dfe06/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.049275 Nov 22 12:19:54.704098 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 78/143] 10.222.0.66 () {60 vars in 1322 bytes} [Mon Nov 22 12:19:53 2021] POST /compute/v2.1/servers/09a121f0-f7e5-4376-96bf-7008344dfe06/os-volume_attachments => generated 194 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 12:19:55.156084 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-76e69bc2-ad53-4aa9-93f9-1de660700638 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:19:55.157672 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-76e69bc2-ad53-4aa9-93f9-1de660700638 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: c9f6d441-246f-479e-8e88-ea701c0f87ff] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:19:55.164815 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-76e69bc2-ad53-4aa9-93f9-1de660700638 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:55.165614 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-76e69bc2-ad53-4aa9-93f9-1de660700638 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:55.166409 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-76e69bc2-ad53-4aa9-93f9-1de660700638 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:55.166896 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-76e69bc2-ad53-4aa9-93f9-1de660700638 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:55.281555 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [req-d7cc1052-7a6d-4a9f-b73f-83c579e2a7d0 req-bce57c18-0b3c-44f0-8c5b-1baafa767361 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9f6d441-246f-479e-8e88-ea701c0f87ff", "name": "network-vif-plugged", "status": "completed", "tag": "c3893e14-5c03-4b6a-b17d-c2dc56e8e688"}]} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:19:55.283788 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 12:19:55.283788 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: warnings.warn(msg) Nov 22 12:19:55.294429 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [req-d7cc1052-7a6d-4a9f-b73f-83c579e2a7d0 req-bce57c18-0b3c-44f0-8c5b-1baafa767361 service nova] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:55.295728 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [req-d7cc1052-7a6d-4a9f-b73f-83c579e2a7d0 req-bce57c18-0b3c-44f0-8c5b-1baafa767361 service nova] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:55.310119 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.compute.server_external_events [req-d7cc1052-7a6d-4a9f-b73f-83c579e2a7d0 req-bce57c18-0b3c-44f0-8c5b-1baafa767361 service nova] Creating event network-vif-plugged:c3893e14-5c03-4b6a-b17d-c2dc56e8e688 for instance c9f6d441-246f-479e-8e88-ea701c0f87ff on hv-cinder-76845 Nov 22 12:19:55.316767 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [req-d7cc1052-7a6d-4a9f-b73f-83c579e2a7d0 req-bce57c18-0b3c-44f0-8c5b-1baafa767361 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040545 Nov 22 12:19:55.318649 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 79/144] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Nov 22 12:19:55 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 22 12:19:55.344556 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-76e69bc2-ad53-4aa9-93f9-1de660700638 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:19:55.356110 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-6dab4238-18a7-4979-8eb9-aa3f42240683 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:19:55.357117 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-76e69bc2-ad53-4aa9-93f9-1de660700638 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:19:55.357279 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-6dab4238-18a7-4979-8eb9-aa3f42240683 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] [instance: 937d4958-6710-4c44-8451-2b659b87dc63] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:19:55.359336 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-76e69bc2-ad53-4aa9-93f9-1de660700638 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:19:55.361309 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-76e69bc2-ad53-4aa9-93f9-1de660700638 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff" status: 200 len: 1407 microversion: 2.20 time: 0.208940 Nov 22 12:19:55.362534 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 66/145] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Nov 22 12:19:55 2021] GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff => generated 1407 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 22 12:19:55.373464 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-6dab4238-18a7-4979-8eb9-aa3f42240683 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:55.373464 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-6dab4238-18a7-4979-8eb9-aa3f42240683 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:55.373464 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-6dab4238-18a7-4979-8eb9-aa3f42240683 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:55.373464 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-6dab4238-18a7-4979-8eb9-aa3f42240683 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:55.566202 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-6dab4238-18a7-4979-8eb9-aa3f42240683 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1efac6c215148ce8c3ecdce1e9a8742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d392a7d77f46fcb4faa017786796fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:19:55.574972 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-6dab4238-18a7-4979-8eb9-aa3f42240683 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] 10.222.0.66 "GET /compute/v2.1/servers/937d4958-6710-4c44-8451-2b659b87dc63" status: 200 len: 1520 microversion: 2.1 time: 0.226825 Nov 22 12:19:55.575681 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 80/146] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:19:55 2021] GET /compute/v2.1/servers/937d4958-6710-4c44-8451-2b659b87dc63 => generated 1520 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 12:19:56.386629 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-66f48bbf-e500-46b5-9af1-e33bcf446011 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:19:56.387871 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-66f48bbf-e500-46b5-9af1-e33bcf446011 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: c9f6d441-246f-479e-8e88-ea701c0f87ff] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:19:56.394918 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-66f48bbf-e500-46b5-9af1-e33bcf446011 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:56.397719 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-66f48bbf-e500-46b5-9af1-e33bcf446011 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:56.398538 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-66f48bbf-e500-46b5-9af1-e33bcf446011 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:56.399171 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-66f48bbf-e500-46b5-9af1-e33bcf446011 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:56.574684 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-66f48bbf-e500-46b5-9af1-e33bcf446011 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:19:56.583373 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-66f48bbf-e500-46b5-9af1-e33bcf446011 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:19:56.584860 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-66f48bbf-e500-46b5-9af1-e33bcf446011 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:19:56.587341 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-66f48bbf-e500-46b5-9af1-e33bcf446011 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff" status: 200 len: 1407 microversion: 2.20 time: 0.210430 Nov 22 12:19:56.593761 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 67/147] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Nov 22 12:19:56 2021] GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff => generated 1407 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 12:19:56.598907 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-595f61fb-ef9f-4304-b291-2d3966550b92 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:19:56.599629 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-595f61fb-ef9f-4304-b291-2d3966550b92 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] [instance: 937d4958-6710-4c44-8451-2b659b87dc63] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:19:56.606399 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-595f61fb-ef9f-4304-b291-2d3966550b92 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:56.606842 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-595f61fb-ef9f-4304-b291-2d3966550b92 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:56.607656 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-595f61fb-ef9f-4304-b291-2d3966550b92 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:56.608262 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-595f61fb-ef9f-4304-b291-2d3966550b92 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:56.764050 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-595f61fb-ef9f-4304-b291-2d3966550b92 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1efac6c215148ce8c3ecdce1e9a8742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d392a7d77f46fcb4faa017786796fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:19:56.772638 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-595f61fb-ef9f-4304-b291-2d3966550b92 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] 10.222.0.66 "GET /compute/v2.1/servers/937d4958-6710-4c44-8451-2b659b87dc63" status: 200 len: 1520 microversion: 2.1 time: 0.177559 Nov 22 12:19:56.782842 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 81/148] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:19:56 2021] GET /compute/v2.1/servers/937d4958-6710-4c44-8451-2b659b87dc63 => generated 1520 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:19:57.603505 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-f50fd041-1eb5-490e-bb9f-03a06790042a tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:19:57.604163 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-f50fd041-1eb5-490e-bb9f-03a06790042a tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: c9f6d441-246f-479e-8e88-ea701c0f87ff] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:19:57.611218 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-f50fd041-1eb5-490e-bb9f-03a06790042a tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:57.611705 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-f50fd041-1eb5-490e-bb9f-03a06790042a tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:57.612494 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-f50fd041-1eb5-490e-bb9f-03a06790042a tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:57.612929 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-f50fd041-1eb5-490e-bb9f-03a06790042a tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:57.750554 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-f50fd041-1eb5-490e-bb9f-03a06790042a tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:19:57.758959 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-f50fd041-1eb5-490e-bb9f-03a06790042a tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:19:57.760785 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-f50fd041-1eb5-490e-bb9f-03a06790042a tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:19:57.762933 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-f50fd041-1eb5-490e-bb9f-03a06790042a tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff" status: 200 len: 1407 microversion: 2.20 time: 0.162560 Nov 22 12:19:57.763535 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 68/149] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Nov 22 12:19:57 2021] GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff => generated 1407 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 12:19:57.790924 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-6a235d4a-88a5-4dc3-b17d-b3bd1d4f1e71 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:19:57.791551 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-6a235d4a-88a5-4dc3-b17d-b3bd1d4f1e71 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] [instance: 937d4958-6710-4c44-8451-2b659b87dc63] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:19:57.798995 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-6a235d4a-88a5-4dc3-b17d-b3bd1d4f1e71 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:57.799990 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-6a235d4a-88a5-4dc3-b17d-b3bd1d4f1e71 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:57.801794 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-6a235d4a-88a5-4dc3-b17d-b3bd1d4f1e71 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:57.802194 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-6a235d4a-88a5-4dc3-b17d-b3bd1d4f1e71 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:57.936508 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-6a235d4a-88a5-4dc3-b17d-b3bd1d4f1e71 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1efac6c215148ce8c3ecdce1e9a8742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d392a7d77f46fcb4faa017786796fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:19:57.943774 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-6a235d4a-88a5-4dc3-b17d-b3bd1d4f1e71 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] 10.222.0.66 "GET /compute/v2.1/servers/937d4958-6710-4c44-8451-2b659b87dc63" status: 200 len: 1520 microversion: 2.1 time: 0.157256 Nov 22 12:19:57.953216 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 82/150] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:19:57 2021] GET /compute/v2.1/servers/937d4958-6710-4c44-8451-2b659b87dc63 => generated 1520 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:19:58.781497 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-aa938035-b242-4a54-97ea-7f942216ff52 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:19:58.782190 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-aa938035-b242-4a54-97ea-7f942216ff52 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: c9f6d441-246f-479e-8e88-ea701c0f87ff] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:19:58.788998 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-aa938035-b242-4a54-97ea-7f942216ff52 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:58.789450 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-aa938035-b242-4a54-97ea-7f942216ff52 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:58.790223 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-aa938035-b242-4a54-97ea-7f942216ff52 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:58.790655 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-aa938035-b242-4a54-97ea-7f942216ff52 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:58.932768 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-aa938035-b242-4a54-97ea-7f942216ff52 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:19:58.941354 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-aa938035-b242-4a54-97ea-7f942216ff52 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:19:58.942835 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-aa938035-b242-4a54-97ea-7f942216ff52 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:19:58.943970 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-aa938035-b242-4a54-97ea-7f942216ff52 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff" status: 200 len: 1407 microversion: 2.20 time: 0.166476 Nov 22 12:19:58.951426 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 69/151] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Nov 22 12:19:58 2021] GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff => generated 1407 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 12:19:58.960695 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-f1be6008-d9c3-4054-b749-a4943c6e97a4 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:19:58.961302 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-f1be6008-d9c3-4054-b749-a4943c6e97a4 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] [instance: 937d4958-6710-4c44-8451-2b659b87dc63] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:19:58.968599 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-f1be6008-d9c3-4054-b749-a4943c6e97a4 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:58.969039 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-f1be6008-d9c3-4054-b749-a4943c6e97a4 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:58.969831 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-f1be6008-d9c3-4054-b749-a4943c6e97a4 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:58.970268 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-f1be6008-d9c3-4054-b749-a4943c6e97a4 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:59.122341 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-f1be6008-d9c3-4054-b749-a4943c6e97a4 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1efac6c215148ce8c3ecdce1e9a8742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d392a7d77f46fcb4faa017786796fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:19:59.130184 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-f1be6008-d9c3-4054-b749-a4943c6e97a4 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] 10.222.0.66 "GET /compute/v2.1/servers/937d4958-6710-4c44-8451-2b659b87dc63" status: 200 len: 1520 microversion: 2.1 time: 0.173456 Nov 22 12:19:59.130847 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 83/152] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:19:58 2021] GET /compute/v2.1/servers/937d4958-6710-4c44-8451-2b659b87dc63 => generated 1520 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:19:59.962611 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-02d06d36-df5e-40e4-95e2-2270014f2415 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:19:59.963473 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-02d06d36-df5e-40e4-95e2-2270014f2415 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: c9f6d441-246f-479e-8e88-ea701c0f87ff] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:19:59.969835 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-02d06d36-df5e-40e4-95e2-2270014f2415 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:59.970272 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-02d06d36-df5e-40e4-95e2-2270014f2415 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:19:59.971120 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-02d06d36-df5e-40e4-95e2-2270014f2415 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:19:59.971513 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-02d06d36-df5e-40e4-95e2-2270014f2415 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:00.114746 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-02d06d36-df5e-40e4-95e2-2270014f2415 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:20:00.123973 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-02d06d36-df5e-40e4-95e2-2270014f2415 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:20:00.125553 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-02d06d36-df5e-40e4-95e2-2270014f2415 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:20:00.134681 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-02d06d36-df5e-40e4-95e2-2270014f2415 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff" status: 200 len: 1407 microversion: 2.20 time: 0.168084 Nov 22 12:20:00.134681 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 70/153] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Nov 22 12:19:59 2021] GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff => generated 1407 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 12:20:00.148455 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-d37d9075-8f5a-4e96-9dc5-3b9697a11eca tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:20:00.151293 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-d37d9075-8f5a-4e96-9dc5-3b9697a11eca tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] [instance: 937d4958-6710-4c44-8451-2b659b87dc63] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:20:00.158116 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-d37d9075-8f5a-4e96-9dc5-3b9697a11eca tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:00.158569 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-d37d9075-8f5a-4e96-9dc5-3b9697a11eca tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:00.159554 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-d37d9075-8f5a-4e96-9dc5-3b9697a11eca tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:00.160296 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-d37d9075-8f5a-4e96-9dc5-3b9697a11eca tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:00.311785 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-d37d9075-8f5a-4e96-9dc5-3b9697a11eca tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1efac6c215148ce8c3ecdce1e9a8742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d392a7d77f46fcb4faa017786796fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:20:00.319960 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-d37d9075-8f5a-4e96-9dc5-3b9697a11eca tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] 10.222.0.66 "GET /compute/v2.1/servers/937d4958-6710-4c44-8451-2b659b87dc63" status: 200 len: 1520 microversion: 2.1 time: 0.175421 Nov 22 12:20:00.321301 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 84/154] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:20:00 2021] GET /compute/v2.1/servers/937d4958-6710-4c44-8451-2b659b87dc63 => generated 1520 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:20:01.144655 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-133743bc-b894-43c0-98b5-2cff48363861 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:20:01.145321 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-133743bc-b894-43c0-98b5-2cff48363861 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: c9f6d441-246f-479e-8e88-ea701c0f87ff] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:20:01.151258 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-133743bc-b894-43c0-98b5-2cff48363861 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:01.151741 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-133743bc-b894-43c0-98b5-2cff48363861 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:01.152533 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-133743bc-b894-43c0-98b5-2cff48363861 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:01.153104 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-133743bc-b894-43c0-98b5-2cff48363861 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:01.292078 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-133743bc-b894-43c0-98b5-2cff48363861 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:20:01.300191 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-133743bc-b894-43c0-98b5-2cff48363861 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:20:01.301713 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-133743bc-b894-43c0-98b5-2cff48363861 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:20:01.302850 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-133743bc-b894-43c0-98b5-2cff48363861 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff" status: 200 len: 1599 microversion: 2.20 time: 0.161890 Nov 22 12:20:01.303602 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 71/155] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Nov 22 12:20:01 2021] GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff => generated 1599 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 12:20:01.320950 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-a1090609-11c5-49c9-ba09-a691ac21e3b0 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:20:01.321488 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-a1090609-11c5-49c9-ba09-a691ac21e3b0 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: c9f6d441-246f-479e-8e88-ea701c0f87ff] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:20:01.328636 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-a1090609-11c5-49c9-ba09-a691ac21e3b0 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:01.329265 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-a1090609-11c5-49c9-ba09-a691ac21e3b0 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:01.330059 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-a1090609-11c5-49c9-ba09-a691ac21e3b0 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:01.330821 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-a1090609-11c5-49c9-ba09-a691ac21e3b0 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:01.338071 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-2f4905d9-6dab-461b-863b-0266fe9bb6b1 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:20:01.338678 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-2f4905d9-6dab-461b-863b-0266fe9bb6b1 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] [instance: 937d4958-6710-4c44-8451-2b659b87dc63] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:20:01.344945 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-2f4905d9-6dab-461b-863b-0266fe9bb6b1 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:01.345387 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-2f4905d9-6dab-461b-863b-0266fe9bb6b1 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:01.346135 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-2f4905d9-6dab-461b-863b-0266fe9bb6b1 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:01.346592 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-2f4905d9-6dab-461b-863b-0266fe9bb6b1 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:01.444000 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-a1090609-11c5-49c9-ba09-a691ac21e3b0 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.126693 Nov 22 12:20:01.444769 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 85/156] 10.222.0.66 () {60 vars in 1315 bytes} [Mon Nov 22 12:20:01 2021] GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff/os-interface => generated 285 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 12:20:01.513878 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-2f4905d9-6dab-461b-863b-0266fe9bb6b1 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1efac6c215148ce8c3ecdce1e9a8742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d392a7d77f46fcb4faa017786796fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:20:01.521892 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-2f4905d9-6dab-461b-863b-0266fe9bb6b1 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] 10.222.0.66 "GET /compute/v2.1/servers/937d4958-6710-4c44-8451-2b659b87dc63" status: 200 len: 1520 microversion: 2.1 time: 0.187661 Nov 22 12:20:01.523006 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 72/157] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:20:01 2021] GET /compute/v2.1/servers/937d4958-6710-4c44-8451-2b659b87dc63 => generated 1520 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:20:02.540373 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-0dd32e5c-c5e7-4a5d-a1f7-2c713ff2b27c tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:20:02.540918 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-0dd32e5c-c5e7-4a5d-a1f7-2c713ff2b27c tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] [instance: 937d4958-6710-4c44-8451-2b659b87dc63] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:20:02.548480 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-0dd32e5c-c5e7-4a5d-a1f7-2c713ff2b27c tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:02.549053 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-0dd32e5c-c5e7-4a5d-a1f7-2c713ff2b27c tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:02.549947 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-0dd32e5c-c5e7-4a5d-a1f7-2c713ff2b27c tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:02.550364 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-0dd32e5c-c5e7-4a5d-a1f7-2c713ff2b27c tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:02.690186 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-0dd32e5c-c5e7-4a5d-a1f7-2c713ff2b27c tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1efac6c215148ce8c3ecdce1e9a8742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d392a7d77f46fcb4faa017786796fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:20:02.698394 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-0dd32e5c-c5e7-4a5d-a1f7-2c713ff2b27c tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] 10.222.0.66 "GET /compute/v2.1/servers/937d4958-6710-4c44-8451-2b659b87dc63" status: 200 len: 1520 microversion: 2.1 time: 0.162083 Nov 22 12:20:02.698940 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 86/158] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:20:02 2021] GET /compute/v2.1/servers/937d4958-6710-4c44-8451-2b659b87dc63 => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:20:02.884056 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-40aecf23-ccfb-4e8d-9cfe-fffc1b9db122 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:20:02.885050 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-40aecf23-ccfb-4e8d-9cfe-fffc1b9db122 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: c9f6d441-246f-479e-8e88-ea701c0f87ff] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:20:02.886755 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [req-6d537129-9c78-49da-bbaa-9a7ac62989b2 req-3a464693-db2c-4c83-9de3-2be73486d195 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9f6d441-246f-479e-8e88-ea701c0f87ff", "tag": "c3893e14-5c03-4b6a-b17d-c2dc56e8e688"}]} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:20:02.888415 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 12:20:02.888415 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: warnings.warn(msg) Nov 22 12:20:02.894812 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-40aecf23-ccfb-4e8d-9cfe-fffc1b9db122 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:02.895281 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-40aecf23-ccfb-4e8d-9cfe-fffc1b9db122 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:02.895400 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [req-6d537129-9c78-49da-bbaa-9a7ac62989b2 req-3a464693-db2c-4c83-9de3-2be73486d195 service nova] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:02.895766 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [req-6d537129-9c78-49da-bbaa-9a7ac62989b2 req-3a464693-db2c-4c83-9de3-2be73486d195 service nova] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:02.896065 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-40aecf23-ccfb-4e8d-9cfe-fffc1b9db122 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:02.896495 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-40aecf23-ccfb-4e8d-9cfe-fffc1b9db122 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:02.908896 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.compute.server_external_events [req-6d537129-9c78-49da-bbaa-9a7ac62989b2 req-3a464693-db2c-4c83-9de3-2be73486d195 service nova] Creating event network-changed:c3893e14-5c03-4b6a-b17d-c2dc56e8e688 for instance c9f6d441-246f-479e-8e88-ea701c0f87ff on hv-cinder-76845 Nov 22 12:20:02.914584 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [req-6d537129-9c78-49da-bbaa-9a7ac62989b2 req-3a464693-db2c-4c83-9de3-2be73486d195 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031251 Nov 22 12:20:02.915163 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 87/159] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Nov 22 12:20:02 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 12:20:03.716451 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-13fae6d1-9b1c-45dc-81b9-22babb6a15de tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:20:03.717251 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-13fae6d1-9b1c-45dc-81b9-22babb6a15de tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] [instance: 937d4958-6710-4c44-8451-2b659b87dc63] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:20:03.723829 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-13fae6d1-9b1c-45dc-81b9-22babb6a15de tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:03.724338 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-13fae6d1-9b1c-45dc-81b9-22babb6a15de tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:03.725178 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-13fae6d1-9b1c-45dc-81b9-22babb6a15de tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:03.725796 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-13fae6d1-9b1c-45dc-81b9-22babb6a15de tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:03.870541 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-13fae6d1-9b1c-45dc-81b9-22babb6a15de tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1efac6c215148ce8c3ecdce1e9a8742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d392a7d77f46fcb4faa017786796fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:20:03.878709 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-13fae6d1-9b1c-45dc-81b9-22babb6a15de tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] 10.222.0.66 "GET /compute/v2.1/servers/937d4958-6710-4c44-8451-2b659b87dc63" status: 200 len: 1520 microversion: 2.1 time: 0.166798 Nov 22 12:20:03.879302 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 88/160] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:20:03 2021] GET /compute/v2.1/servers/937d4958-6710-4c44-8451-2b659b87dc63 => generated 1520 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:20:04.896469 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-7fb935e0-a6de-423c-8d72-b4674151bb33 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:20:04.897164 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-7fb935e0-a6de-423c-8d72-b4674151bb33 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] [instance: 937d4958-6710-4c44-8451-2b659b87dc63] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:20:04.903878 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-7fb935e0-a6de-423c-8d72-b4674151bb33 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:04.904323 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-7fb935e0-a6de-423c-8d72-b4674151bb33 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:04.905110 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-7fb935e0-a6de-423c-8d72-b4674151bb33 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:04.905542 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-7fb935e0-a6de-423c-8d72-b4674151bb33 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:05.060411 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-7fb935e0-a6de-423c-8d72-b4674151bb33 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1efac6c215148ce8c3ecdce1e9a8742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d392a7d77f46fcb4faa017786796fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:20:05.071684 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-7fb935e0-a6de-423c-8d72-b4674151bb33 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] 10.222.0.66 "GET /compute/v2.1/servers/937d4958-6710-4c44-8451-2b659b87dc63" status: 200 len: 1520 microversion: 2.1 time: 0.178648 Nov 22 12:20:05.072313 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 89/161] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:20:04 2021] GET /compute/v2.1/servers/937d4958-6710-4c44-8451-2b659b87dc63 => generated 1520 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:20:05.583449 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-40aecf23-ccfb-4e8d-9cfe-fffc1b9db122 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "POST /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff/action" status: 200 len: 14 microversion: 2.20 time: 2.702609 Nov 22 12:20:05.584501 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 73/162] 10.222.0.66 () {62 vars in 1318 bytes} [Mon Nov 22 12:20:02 2021] POST /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff/action => generated 14 bytes in 2705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 12:20:06.089321 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-8c16d358-012a-49bd-a57c-39e51ef1946d tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:20:06.089843 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-8c16d358-012a-49bd-a57c-39e51ef1946d tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] [instance: 937d4958-6710-4c44-8451-2b659b87dc63] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:20:06.097587 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-8c16d358-012a-49bd-a57c-39e51ef1946d tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:06.098040 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-8c16d358-012a-49bd-a57c-39e51ef1946d tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:06.104938 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-8c16d358-012a-49bd-a57c-39e51ef1946d tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:06.104938 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-8c16d358-012a-49bd-a57c-39e51ef1946d tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:06.369026 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-8c16d358-012a-49bd-a57c-39e51ef1946d tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1efac6c215148ce8c3ecdce1e9a8742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d392a7d77f46fcb4faa017786796fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:20:06.377111 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-8c16d358-012a-49bd-a57c-39e51ef1946d tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] 10.222.0.66 "GET /compute/v2.1/servers/937d4958-6710-4c44-8451-2b659b87dc63" status: 200 len: 1520 microversion: 2.1 time: 0.291962 Nov 22 12:20:06.377669 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 90/163] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:20:06 2021] GET /compute/v2.1/servers/937d4958-6710-4c44-8451-2b659b87dc63 => generated 1520 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:20:06.595691 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-f9fe7625-66c2-43e6-9697-784f489bf6d1 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:20:06.596695 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-f9fe7625-66c2-43e6-9697-784f489bf6d1 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: c9f6d441-246f-479e-8e88-ea701c0f87ff] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:20:06.603647 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-f9fe7625-66c2-43e6-9697-784f489bf6d1 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:06.604387 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-f9fe7625-66c2-43e6-9697-784f489bf6d1 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:06.605180 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-f9fe7625-66c2-43e6-9697-784f489bf6d1 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:06.605615 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-f9fe7625-66c2-43e6-9697-784f489bf6d1 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:06.633769 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-295eb71f-04fa-45d7-8668-17d4e80adeed tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:20:06.634265 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-295eb71f-04fa-45d7-8668-17d4e80adeed tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] [instance: 0e1fe798-845f-4f01-b699-0e2fac35e5c3] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:20:06.640386 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-295eb71f-04fa-45d7-8668-17d4e80adeed tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:06.640867 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-295eb71f-04fa-45d7-8668-17d4e80adeed tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:06.641639 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-295eb71f-04fa-45d7-8668-17d4e80adeed tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:06.642069 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-295eb71f-04fa-45d7-8668-17d4e80adeed tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:06.667536 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-295eb71f-04fa-45d7-8668-17d4e80adeed tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] [instance: 0e1fe798-845f-4f01-b699-0e2fac35e5c3] Going to try to terminate instance {{(pid=116272) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 22 12:20:06.677825 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-f9fe7625-66c2-43e6-9697-784f489bf6d1 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "POST /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff/action" status: 200 len: 14 microversion: 2.20 time: 0.086095 Nov 22 12:20:06.681084 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 74/164] 10.222.0.66 () {62 vars in 1318 bytes} [Mon Nov 22 12:20:06 2021] POST /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff/action => generated 14 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:20:06.762885 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-295eb71f-04fa-45d7-8668-17d4e80adeed tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] 10.222.0.66 "DELETE /compute/v2.1/servers/0e1fe798-845f-4f01-b699-0e2fac35e5c3" status: 204 len: 0 microversion: 2.1 time: 0.131864 Nov 22 12:20:06.763539 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 91/165] 10.222.0.66 () {58 vars in 1238 bytes} [Mon Nov 22 12:20:06 2021] DELETE /compute/v2.1/servers/0e1fe798-845f-4f01-b699-0e2fac35e5c3 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 22 12:20:06.772758 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-831fe584-9b93-45e0-8488-386efea8a230 tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:20:06.773447 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-831fe584-9b93-45e0-8488-386efea8a230 tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] [instance: 0e1fe798-845f-4f01-b699-0e2fac35e5c3] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:20:06.781169 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-831fe584-9b93-45e0-8488-386efea8a230 tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:06.781610 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-831fe584-9b93-45e0-8488-386efea8a230 tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:06.782383 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-831fe584-9b93-45e0-8488-386efea8a230 tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:06.782805 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-831fe584-9b93-45e0-8488-386efea8a230 tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:06.938718 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-831fe584-9b93-45e0-8488-386efea8a230 tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3127e81d7664dbbbce53d6d7f2bae4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c32f9960704ce6b26019efdc2abddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:20:06.947508 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-831fe584-9b93-45e0-8488-386efea8a230 tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] 10.222.0.66 "GET /compute/v2.1/servers/0e1fe798-845f-4f01-b699-0e2fac35e5c3" status: 200 len: 1555 microversion: 2.1 time: 0.178816 Nov 22 12:20:06.948076 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 75/166] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:20:06 2021] GET /compute/v2.1/servers/0e1fe798-845f-4f01-b699-0e2fac35e5c3 => generated 1555 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 12:20:07.397399 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-c1fe291b-22e2-4f83-aa68-a437cc9b6faa tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:20:07.398221 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-c1fe291b-22e2-4f83-aa68-a437cc9b6faa tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] [instance: 937d4958-6710-4c44-8451-2b659b87dc63] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:20:07.404357 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-c1fe291b-22e2-4f83-aa68-a437cc9b6faa tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:07.405437 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-c1fe291b-22e2-4f83-aa68-a437cc9b6faa tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:07.406548 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-c1fe291b-22e2-4f83-aa68-a437cc9b6faa tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:07.406936 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-c1fe291b-22e2-4f83-aa68-a437cc9b6faa tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:07.584914 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-c1fe291b-22e2-4f83-aa68-a437cc9b6faa tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1efac6c215148ce8c3ecdce1e9a8742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d392a7d77f46fcb4faa017786796fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:20:07.593225 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-c1fe291b-22e2-4f83-aa68-a437cc9b6faa tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] 10.222.0.66 "GET /compute/v2.1/servers/937d4958-6710-4c44-8451-2b659b87dc63" status: 200 len: 1520 microversion: 2.1 time: 0.201856 Nov 22 12:20:07.594028 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 92/167] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:20:07 2021] GET /compute/v2.1/servers/937d4958-6710-4c44-8451-2b659b87dc63 => generated 1520 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:20:07.688796 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-4e238e37-9830-4bea-ac44-30ded38c7e0f tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:20:07.690649 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-4e238e37-9830-4bea-ac44-30ded38c7e0f tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: c9f6d441-246f-479e-8e88-ea701c0f87ff] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:20:07.696727 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-4e238e37-9830-4bea-ac44-30ded38c7e0f tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:07.697262 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-4e238e37-9830-4bea-ac44-30ded38c7e0f tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:07.698231 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-4e238e37-9830-4bea-ac44-30ded38c7e0f tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:07.698882 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-4e238e37-9830-4bea-ac44-30ded38c7e0f tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:07.785756 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-4e238e37-9830-4bea-ac44-30ded38c7e0f tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "POST /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff/action" status: 200 len: 14 microversion: 2.20 time: 0.100090 Nov 22 12:20:07.786493 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 76/168] 10.222.0.66 () {62 vars in 1318 bytes} [Mon Nov 22 12:20:07 2021] POST /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff/action => generated 14 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:20:07.964690 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-c0c1fb95-dff0-4ebb-ac80-5248cea50153 tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:20:07.965292 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-c0c1fb95-dff0-4ebb-ac80-5248cea50153 tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] [instance: 0e1fe798-845f-4f01-b699-0e2fac35e5c3] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:20:07.971740 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-c0c1fb95-dff0-4ebb-ac80-5248cea50153 tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:07.972248 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-c0c1fb95-dff0-4ebb-ac80-5248cea50153 tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:07.973027 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-c0c1fb95-dff0-4ebb-ac80-5248cea50153 tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:07.973435 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-c0c1fb95-dff0-4ebb-ac80-5248cea50153 tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:08.152199 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-c0c1fb95-dff0-4ebb-ac80-5248cea50153 tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3127e81d7664dbbbce53d6d7f2bae4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c32f9960704ce6b26019efdc2abddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:20:08.161685 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-c0c1fb95-dff0-4ebb-ac80-5248cea50153 tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] 10.222.0.66 "GET /compute/v2.1/servers/0e1fe798-845f-4f01-b699-0e2fac35e5c3" status: 200 len: 1555 microversion: 2.1 time: 0.200633 Nov 22 12:20:08.162282 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 93/169] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:20:07 2021] GET /compute/v2.1/servers/0e1fe798-845f-4f01-b699-0e2fac35e5c3 => generated 1555 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:20:08.611468 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-b4e128bc-43c2-4df2-9272-10b0747173b9 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:20:08.612589 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-b4e128bc-43c2-4df2-9272-10b0747173b9 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] [instance: 937d4958-6710-4c44-8451-2b659b87dc63] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:20:08.620721 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-b4e128bc-43c2-4df2-9272-10b0747173b9 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:08.621466 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-b4e128bc-43c2-4df2-9272-10b0747173b9 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:08.622578 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-b4e128bc-43c2-4df2-9272-10b0747173b9 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:08.623221 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-b4e128bc-43c2-4df2-9272-10b0747173b9 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:08.797085 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-ef111c0b-1f31-44b4-9e60-b80f3f4db075 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:20:08.798754 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-ef111c0b-1f31-44b4-9e60-b80f3f4db075 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: c9f6d441-246f-479e-8e88-ea701c0f87ff] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:20:08.806225 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-b4e128bc-43c2-4df2-9272-10b0747173b9 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1efac6c215148ce8c3ecdce1e9a8742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d392a7d77f46fcb4faa017786796fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:20:08.806784 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-ef111c0b-1f31-44b4-9e60-b80f3f4db075 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:08.807187 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-ef111c0b-1f31-44b4-9e60-b80f3f4db075 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:08.808115 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-ef111c0b-1f31-44b4-9e60-b80f3f4db075 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:08.808698 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-ef111c0b-1f31-44b4-9e60-b80f3f4db075 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:08.819668 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-b4e128bc-43c2-4df2-9272-10b0747173b9 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] 10.222.0.66 "GET /compute/v2.1/servers/937d4958-6710-4c44-8451-2b659b87dc63" status: 200 len: 1520 microversion: 2.1 time: 0.212641 Nov 22 12:20:08.820264 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 77/170] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:20:08 2021] GET /compute/v2.1/servers/937d4958-6710-4c44-8451-2b659b87dc63 => generated 1520 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:20:08.897822 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-ef111c0b-1f31-44b4-9e60-b80f3f4db075 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "POST /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff/action" status: 200 len: 14 microversion: 2.20 time: 0.104813 Nov 22 12:20:08.901101 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 94/171] 10.222.0.66 () {62 vars in 1318 bytes} [Mon Nov 22 12:20:08 2021] POST /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff/action => generated 14 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 12:20:09.180948 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-a188acca-ea8b-45c5-9ce6-4fc32589a6eb tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:20:09.182053 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-a188acca-ea8b-45c5-9ce6-4fc32589a6eb tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] [instance: 0e1fe798-845f-4f01-b699-0e2fac35e5c3] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:20:09.190694 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-a188acca-ea8b-45c5-9ce6-4fc32589a6eb tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:09.191766 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-a188acca-ea8b-45c5-9ce6-4fc32589a6eb tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:09.192733 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-a188acca-ea8b-45c5-9ce6-4fc32589a6eb tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:09.193308 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-a188acca-ea8b-45c5-9ce6-4fc32589a6eb tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:09.382212 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-a188acca-ea8b-45c5-9ce6-4fc32589a6eb tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3127e81d7664dbbbce53d6d7f2bae4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c32f9960704ce6b26019efdc2abddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:20:09.392358 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-a188acca-ea8b-45c5-9ce6-4fc32589a6eb tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] 10.222.0.66 "GET /compute/v2.1/servers/0e1fe798-845f-4f01-b699-0e2fac35e5c3" status: 200 len: 1555 microversion: 2.1 time: 0.217057 Nov 22 12:20:09.393351 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 78/172] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:20:09 2021] GET /compute/v2.1/servers/0e1fe798-845f-4f01-b699-0e2fac35e5c3 => generated 1555 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:20:09.837030 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-d03fba33-6444-487e-a4ff-e116c03b713c tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:20:09.838342 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-d03fba33-6444-487e-a4ff-e116c03b713c tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] [instance: 937d4958-6710-4c44-8451-2b659b87dc63] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:20:09.845749 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-d03fba33-6444-487e-a4ff-e116c03b713c tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:09.846193 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-d03fba33-6444-487e-a4ff-e116c03b713c tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:09.848413 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-d03fba33-6444-487e-a4ff-e116c03b713c tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:09.848852 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-d03fba33-6444-487e-a4ff-e116c03b713c tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:09.910351 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-8d10d8c3-8d43-4a15-9c64-a6adce791be4 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:20:09.911638 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-8d10d8c3-8d43-4a15-9c64-a6adce791be4 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: c9f6d441-246f-479e-8e88-ea701c0f87ff] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:20:09.918285 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-8d10d8c3-8d43-4a15-9c64-a6adce791be4 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:09.918738 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-8d10d8c3-8d43-4a15-9c64-a6adce791be4 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:09.919650 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-8d10d8c3-8d43-4a15-9c64-a6adce791be4 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:09.920592 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-8d10d8c3-8d43-4a15-9c64-a6adce791be4 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:09.995551 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-8d10d8c3-8d43-4a15-9c64-a6adce791be4 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "POST /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff/action" status: 200 len: 14 microversion: 2.20 time: 0.089661 Nov 22 12:20:09.998845 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 79/173] 10.222.0.66 () {62 vars in 1318 bytes} [Mon Nov 22 12:20:09 2021] POST /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff/action => generated 14 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:20:10.198437 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-d03fba33-6444-487e-a4ff-e116c03b713c tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1efac6c215148ce8c3ecdce1e9a8742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d392a7d77f46fcb4faa017786796fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:20:10.208589 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-d03fba33-6444-487e-a4ff-e116c03b713c tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] 10.222.0.66 "GET /compute/v2.1/servers/937d4958-6710-4c44-8451-2b659b87dc63" status: 200 len: 1520 microversion: 2.1 time: 0.375001 Nov 22 12:20:10.209372 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 95/174] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:20:09 2021] GET /compute/v2.1/servers/937d4958-6710-4c44-8451-2b659b87dc63 => generated 1520 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:20:10.375434 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [req-c99a1cbb-d3da-40b3-bd68-c42f18b918a1 req-40562649-d2cd-4d79-8a6d-0d92ffe58b7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e1fe798-845f-4f01-b699-0e2fac35e5c3", "name": "network-vif-deleted", "tag": "bbc86ff1-847c-4237-907d-5d5ba197dac4"}]} {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:20:10.377272 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 12:20:10.377272 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: warnings.warn(msg) Nov 22 12:20:10.388606 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [req-c99a1cbb-d3da-40b3-bd68-c42f18b918a1 req-40562649-d2cd-4d79-8a6d-0d92ffe58b7c service nova] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:10.388961 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [req-c99a1cbb-d3da-40b3-bd68-c42f18b918a1 req-40562649-d2cd-4d79-8a6d-0d92ffe58b7c service nova] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:10.409837 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-ec9976dc-e232-4e2d-94af-74fc090fd102 tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:20:10.411090 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-ec9976dc-e232-4e2d-94af-74fc090fd102 tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] [instance: 0e1fe798-845f-4f01-b699-0e2fac35e5c3] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:20:10.421999 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.compute.server_external_events [req-c99a1cbb-d3da-40b3-bd68-c42f18b918a1 req-40562649-d2cd-4d79-8a6d-0d92ffe58b7c service nova] Creating event network-vif-deleted:bbc86ff1-847c-4237-907d-5d5ba197dac4 for instance 0e1fe798-845f-4f01-b699-0e2fac35e5c3 on hv-cinder-76845 Nov 22 12:20:10.427997 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [req-c99a1cbb-d3da-40b3-bd68-c42f18b918a1 req-40562649-d2cd-4d79-8a6d-0d92ffe58b7c service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057154 Nov 22 12:20:10.431639 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-ec9976dc-e232-4e2d-94af-74fc090fd102 tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:10.432520 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-ec9976dc-e232-4e2d-94af-74fc090fd102 tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:10.433611 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-ec9976dc-e232-4e2d-94af-74fc090fd102 tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:10.434343 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-ec9976dc-e232-4e2d-94af-74fc090fd102 tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:10.451649 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 80/175] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Nov 22 12:20:10 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 12:20:10.510827 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-ec9976dc-e232-4e2d-94af-74fc090fd102 tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3127e81d7664dbbbce53d6d7f2bae4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95c32f9960704ce6b26019efdc2abddc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:20:10.518993 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-ec9976dc-e232-4e2d-94af-74fc090fd102 tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] 10.222.0.66 "GET /compute/v2.1/servers/0e1fe798-845f-4f01-b699-0e2fac35e5c3" status: 200 len: 1346 microversion: 2.1 time: 0.113278 Nov 22 12:20:10.519596 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 96/176] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:20:10 2021] GET /compute/v2.1/servers/0e1fe798-845f-4f01-b699-0e2fac35e5c3 => generated 1346 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:20:11.007349 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-c6d0a146-afa7-49e8-a115-47f547e1eb09 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:20:11.008931 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-c6d0a146-afa7-49e8-a115-47f547e1eb09 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: c9f6d441-246f-479e-8e88-ea701c0f87ff] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:20:11.018099 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-c6d0a146-afa7-49e8-a115-47f547e1eb09 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:11.018645 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-c6d0a146-afa7-49e8-a115-47f547e1eb09 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:11.019692 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-c6d0a146-afa7-49e8-a115-47f547e1eb09 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:11.020200 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-c6d0a146-afa7-49e8-a115-47f547e1eb09 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:11.104701 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-c6d0a146-afa7-49e8-a115-47f547e1eb09 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "POST /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff/action" status: 200 len: 14 microversion: 2.20 time: 0.101669 Nov 22 12:20:11.105358 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 81/177] 10.222.0.66 () {62 vars in 1318 bytes} [Mon Nov 22 12:20:11 2021] POST /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff/action => generated 14 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 12:20:11.229295 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-2b09103d-6de6-4ff0-8ba5-f2ae7df39fb2 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:20:11.229904 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-2b09103d-6de6-4ff0-8ba5-f2ae7df39fb2 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] [instance: 937d4958-6710-4c44-8451-2b659b87dc63] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:20:11.237036 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-2b09103d-6de6-4ff0-8ba5-f2ae7df39fb2 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:11.237457 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-2b09103d-6de6-4ff0-8ba5-f2ae7df39fb2 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:11.238488 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-2b09103d-6de6-4ff0-8ba5-f2ae7df39fb2 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:11.238916 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-2b09103d-6de6-4ff0-8ba5-f2ae7df39fb2 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:11.402052 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-2b09103d-6de6-4ff0-8ba5-f2ae7df39fb2 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1efac6c215148ce8c3ecdce1e9a8742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d392a7d77f46fcb4faa017786796fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:20:11.412463 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-2b09103d-6de6-4ff0-8ba5-f2ae7df39fb2 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] 10.222.0.66 "GET /compute/v2.1/servers/937d4958-6710-4c44-8451-2b659b87dc63" status: 200 len: 1520 microversion: 2.1 time: 0.188107 Nov 22 12:20:11.413651 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 97/178] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:20:11 2021] GET /compute/v2.1/servers/937d4958-6710-4c44-8451-2b659b87dc63 => generated 1520 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:20:11.537184 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-352c5a81-9032-419a-92d5-f455656e93ed tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:20:11.537907 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-352c5a81-9032-419a-92d5-f455656e93ed tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] [instance: 0e1fe798-845f-4f01-b699-0e2fac35e5c3] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:20:11.544449 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-352c5a81-9032-419a-92d5-f455656e93ed tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:11.544994 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-352c5a81-9032-419a-92d5-f455656e93ed tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:11.545639 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-352c5a81-9032-419a-92d5-f455656e93ed tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:11.546064 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-352c5a81-9032-419a-92d5-f455656e93ed tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:11.560933 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.wsgi [None req-352c5a81-9032-419a-92d5-f455656e93ed tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] HTTP exception thrown: Instance 0e1fe798-845f-4f01-b699-0e2fac35e5c3 could not be found. Nov 22 12:20:11.561518 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-352c5a81-9032-419a-92d5-f455656e93ed tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Returning 404 to user: Instance 0e1fe798-845f-4f01-b699-0e2fac35e5c3 could not be found. {{(pid=116273) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 12:20:11.562363 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-352c5a81-9032-419a-92d5-f455656e93ed tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] 10.222.0.66 "GET /compute/v2.1/servers/0e1fe798-845f-4f01-b699-0e2fac35e5c3" status: 404 len: 111 microversion: 2.1 time: 0.029567 Nov 22 12:20:11.562885 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 82/179] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:20:11 2021] GET /compute/v2.1/servers/0e1fe798-845f-4f01-b699-0e2fac35e5c3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 22 12:20:11.698678 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-c88d042f-0177-4647-9b5a-a23aeda24960 tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:20:11.699618 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-c88d042f-0177-4647-9b5a-a23aeda24960 tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] [instance: 0e1fe798-845f-4f01-b699-0e2fac35e5c3] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:20:11.705840 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-c88d042f-0177-4647-9b5a-a23aeda24960 tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:11.706287 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-c88d042f-0177-4647-9b5a-a23aeda24960 tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:11.707743 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-c88d042f-0177-4647-9b5a-a23aeda24960 tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:11.708186 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-c88d042f-0177-4647-9b5a-a23aeda24960 tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:11.721069 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.wsgi [None req-c88d042f-0177-4647-9b5a-a23aeda24960 tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] HTTP exception thrown: Instance 0e1fe798-845f-4f01-b699-0e2fac35e5c3 could not be found. Nov 22 12:20:11.721621 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-c88d042f-0177-4647-9b5a-a23aeda24960 tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Returning 404 to user: Instance 0e1fe798-845f-4f01-b699-0e2fac35e5c3 could not be found. {{(pid=116272) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 12:20:11.722813 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-c88d042f-0177-4647-9b5a-a23aeda24960 tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] 10.222.0.66 "GET /compute/v2.1/servers/0e1fe798-845f-4f01-b699-0e2fac35e5c3/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.027979 Nov 22 12:20:11.723382 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 98/180] 10.222.0.66 () {58 vars in 1301 bytes} [Mon Nov 22 12:20:11 2021] GET /compute/v2.1/servers/0e1fe798-845f-4f01-b699-0e2fac35e5c3/os-volume_attachments => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 22 12:20:12.121020 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-86b766cb-e9d4-4e92-9f17-10bda09ec19a tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:20:12.122110 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-86b766cb-e9d4-4e92-9f17-10bda09ec19a tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: c9f6d441-246f-479e-8e88-ea701c0f87ff] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:20:12.132767 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-86b766cb-e9d4-4e92-9f17-10bda09ec19a tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:12.133217 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-86b766cb-e9d4-4e92-9f17-10bda09ec19a tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:12.134012 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-86b766cb-e9d4-4e92-9f17-10bda09ec19a tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:12.134437 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-86b766cb-e9d4-4e92-9f17-10bda09ec19a tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:12.228109 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-86b766cb-e9d4-4e92-9f17-10bda09ec19a tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "POST /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff/action" status: 200 len: 14 microversion: 2.20 time: 0.113792 Nov 22 12:20:12.232528 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 83/181] 10.222.0.66 () {62 vars in 1318 bytes} [Mon Nov 22 12:20:12 2021] POST /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff/action => generated 14 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:20:12.432726 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-3afc6b65-f838-4da7-a351-f3d0e2933833 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:20:12.434970 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-3afc6b65-f838-4da7-a351-f3d0e2933833 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] [instance: 937d4958-6710-4c44-8451-2b659b87dc63] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:20:12.443935 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-3afc6b65-f838-4da7-a351-f3d0e2933833 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:12.445001 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-3afc6b65-f838-4da7-a351-f3d0e2933833 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:12.447591 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-3afc6b65-f838-4da7-a351-f3d0e2933833 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:12.447754 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-3afc6b65-f838-4da7-a351-f3d0e2933833 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:12.635499 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-3afc6b65-f838-4da7-a351-f3d0e2933833 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1efac6c215148ce8c3ecdce1e9a8742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d392a7d77f46fcb4faa017786796fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:20:12.648004 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-3afc6b65-f838-4da7-a351-f3d0e2933833 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] 10.222.0.66 "GET /compute/v2.1/servers/937d4958-6710-4c44-8451-2b659b87dc63" status: 200 len: 1520 microversion: 2.1 time: 0.220885 Nov 22 12:20:12.648708 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 99/182] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:20:12 2021] GET /compute/v2.1/servers/937d4958-6710-4c44-8451-2b659b87dc63 => generated 1520 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:20:12.962082 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-2044590a-65ef-4f8b-93f0-5dbb7f760c9a tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:20:12.962657 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-2044590a-65ef-4f8b-93f0-5dbb7f760c9a tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] [instance: 0e1fe798-845f-4f01-b699-0e2fac35e5c3] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:20:12.978551 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-2044590a-65ef-4f8b-93f0-5dbb7f760c9a tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:12.979079 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-2044590a-65ef-4f8b-93f0-5dbb7f760c9a tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:12.979845 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-2044590a-65ef-4f8b-93f0-5dbb7f760c9a tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:12.980276 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-2044590a-65ef-4f8b-93f0-5dbb7f760c9a tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:12.996162 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.wsgi [None req-2044590a-65ef-4f8b-93f0-5dbb7f760c9a tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] HTTP exception thrown: Instance 0e1fe798-845f-4f01-b699-0e2fac35e5c3 could not be found. Nov 22 12:20:12.996824 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-2044590a-65ef-4f8b-93f0-5dbb7f760c9a tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Returning 404 to user: Instance 0e1fe798-845f-4f01-b699-0e2fac35e5c3 could not be found. {{(pid=116273) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 12:20:12.997737 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-2044590a-65ef-4f8b-93f0-5dbb7f760c9a tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] 10.222.0.66 "DELETE /compute/v2.1/servers/0e1fe798-845f-4f01-b699-0e2fac35e5c3" status: 404 len: 111 microversion: 2.1 time: 0.039948 Nov 22 12:20:12.998325 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 84/183] 10.222.0.66 () {58 vars in 1238 bytes} [Mon Nov 22 12:20:12 2021] DELETE /compute/v2.1/servers/0e1fe798-845f-4f01-b699-0e2fac35e5c3 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 22 12:20:13.006065 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-66564f77-0d11-49bb-8ed4-0bec23594dba tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:20:13.006668 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-66564f77-0d11-49bb-8ed4-0bec23594dba tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] [instance: 0e1fe798-845f-4f01-b699-0e2fac35e5c3] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:20:13.012484 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-66564f77-0d11-49bb-8ed4-0bec23594dba tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:13.013018 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-66564f77-0d11-49bb-8ed4-0bec23594dba tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:13.013854 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-66564f77-0d11-49bb-8ed4-0bec23594dba tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:13.014281 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-66564f77-0d11-49bb-8ed4-0bec23594dba tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:13.027521 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.wsgi [None req-66564f77-0d11-49bb-8ed4-0bec23594dba tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] HTTP exception thrown: Instance 0e1fe798-845f-4f01-b699-0e2fac35e5c3 could not be found. Nov 22 12:20:13.028094 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-66564f77-0d11-49bb-8ed4-0bec23594dba tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] Returning 404 to user: Instance 0e1fe798-845f-4f01-b699-0e2fac35e5c3 could not be found. {{(pid=116272) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 12:20:13.029058 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-66564f77-0d11-49bb-8ed4-0bec23594dba tempest-DeleteServersTestJSON-546359454 tempest-DeleteServersTestJSON-546359454-project] 10.222.0.66 "GET /compute/v2.1/servers/0e1fe798-845f-4f01-b699-0e2fac35e5c3" status: 404 len: 111 microversion: 2.1 time: 0.026563 Nov 22 12:20:13.029605 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 100/184] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:20:13 2021] GET /compute/v2.1/servers/0e1fe798-845f-4f01-b699-0e2fac35e5c3 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 22 12:20:13.083509 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-5c9a631d-8bbc-4400-ae0b-6f49afa4a3f8 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-355695978", "imageRef": "31affc49-b6f0-44da-af65-4c65d72458b9", "flavorRef": "452", "networks": [{"uuid": "1a398bbd-8494-4c78-9a7f-9328646aea45"}]}} {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:20:13.239703 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-fbeaad0e-8e50-446c-9ba5-7c70e9479ed8 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:20:13.240627 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-fbeaad0e-8e50-446c-9ba5-7c70e9479ed8 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: c9f6d441-246f-479e-8e88-ea701c0f87ff] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:20:13.246834 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-fbeaad0e-8e50-446c-9ba5-7c70e9479ed8 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:13.247371 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-fbeaad0e-8e50-446c-9ba5-7c70e9479ed8 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:13.248511 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-fbeaad0e-8e50-446c-9ba5-7c70e9479ed8 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:13.248928 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-fbeaad0e-8e50-446c-9ba5-7c70e9479ed8 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:13.328263 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-fbeaad0e-8e50-446c-9ba5-7c70e9479ed8 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "POST /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff/action" status: 200 len: 14 microversion: 2.20 time: 0.092860 Nov 22 12:20:13.328875 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 101/185] 10.222.0.66 () {62 vars in 1318 bytes} [Mon Nov 22 12:20:13 2021] POST /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff/action => generated 14 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:20:13.665614 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-9a1a980a-4803-40b7-a058-33cfcfc5cc92 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:20:13.666552 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-9a1a980a-4803-40b7-a058-33cfcfc5cc92 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] [instance: 937d4958-6710-4c44-8451-2b659b87dc63] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:20:13.674545 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-9a1a980a-4803-40b7-a058-33cfcfc5cc92 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:13.675384 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-9a1a980a-4803-40b7-a058-33cfcfc5cc92 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:13.676395 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-9a1a980a-4803-40b7-a058-33cfcfc5cc92 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:13.677040 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-9a1a980a-4803-40b7-a058-33cfcfc5cc92 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:13.975714 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-9a1a980a-4803-40b7-a058-33cfcfc5cc92 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1efac6c215148ce8c3ecdce1e9a8742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d392a7d77f46fcb4faa017786796fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:20:14.008406 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-9a1a980a-4803-40b7-a058-33cfcfc5cc92 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] 10.222.0.66 "GET /compute/v2.1/servers/937d4958-6710-4c44-8451-2b659b87dc63" status: 200 len: 1520 microversion: 2.1 time: 0.347522 Nov 22 12:20:14.009453 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 102/186] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:20:13 2021] GET /compute/v2.1/servers/937d4958-6710-4c44-8451-2b659b87dc63 => generated 1520 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 12:20:14.339816 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-848f96c5-2100-4faa-817b-4ce75aeb359c tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:20:14.340760 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-848f96c5-2100-4faa-817b-4ce75aeb359c tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: c9f6d441-246f-479e-8e88-ea701c0f87ff] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:20:14.350816 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-848f96c5-2100-4faa-817b-4ce75aeb359c tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:14.352252 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-848f96c5-2100-4faa-817b-4ce75aeb359c tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:14.353121 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-848f96c5-2100-4faa-817b-4ce75aeb359c tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:14.353552 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-848f96c5-2100-4faa-817b-4ce75aeb359c tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:14.467832 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-848f96c5-2100-4faa-817b-4ce75aeb359c tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "POST /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff/action" status: 200 len: 14 microversion: 2.20 time: 0.130878 Nov 22 12:20:14.468793 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 103/187] 10.222.0.66 () {62 vars in 1318 bytes} [Mon Nov 22 12:20:14 2021] POST /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff/action => generated 14 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:20:15.026488 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-7dbb9ad3-edf1-46b9-b0b6-3428eaebf882 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:20:15.027293 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-7dbb9ad3-edf1-46b9-b0b6-3428eaebf882 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] [instance: 937d4958-6710-4c44-8451-2b659b87dc63] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:20:15.034470 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-7dbb9ad3-edf1-46b9-b0b6-3428eaebf882 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:15.035030 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-7dbb9ad3-edf1-46b9-b0b6-3428eaebf882 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:15.036308 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-7dbb9ad3-edf1-46b9-b0b6-3428eaebf882 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:15.036845 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-7dbb9ad3-edf1-46b9-b0b6-3428eaebf882 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:15.248616 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-7dbb9ad3-edf1-46b9-b0b6-3428eaebf882 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1efac6c215148ce8c3ecdce1e9a8742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d392a7d77f46fcb4faa017786796fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:20:15.262422 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-7dbb9ad3-edf1-46b9-b0b6-3428eaebf882 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] 10.222.0.66 "GET /compute/v2.1/servers/937d4958-6710-4c44-8451-2b659b87dc63" status: 200 len: 1520 microversion: 2.1 time: 0.237274 Nov 22 12:20:15.262422 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 104/188] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:20:15 2021] GET /compute/v2.1/servers/937d4958-6710-4c44-8451-2b659b87dc63 => generated 1520 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 12:20:15.479880 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-7239e94f-d726-48ed-99f9-268513086821 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:20:15.480804 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-7239e94f-d726-48ed-99f9-268513086821 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: c9f6d441-246f-479e-8e88-ea701c0f87ff] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:20:15.488444 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-7239e94f-d726-48ed-99f9-268513086821 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:15.489038 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-7239e94f-d726-48ed-99f9-268513086821 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:15.489968 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-7239e94f-d726-48ed-99f9-268513086821 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:15.490567 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-7239e94f-d726-48ed-99f9-268513086821 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:17.805906 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-7239e94f-d726-48ed-99f9-268513086821 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "POST /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff/action" status: 200 len: 14 microversion: 2.20 time: 2.329975 Nov 22 12:20:17.806839 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 105/189] 10.222.0.66 () {62 vars in 1318 bytes} [Mon Nov 22 12:20:15 2021] POST /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff/action => generated 14 bytes in 2332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:20:17.812107 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-52f4d695-3274-4326-8d4c-1562be7a896e tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:20:17.812997 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-52f4d695-3274-4326-8d4c-1562be7a896e tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] [instance: 937d4958-6710-4c44-8451-2b659b87dc63] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:20:17.822265 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-52f4d695-3274-4326-8d4c-1562be7a896e tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:17.828343 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-52f4d695-3274-4326-8d4c-1562be7a896e tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:17.829477 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-52f4d695-3274-4326-8d4c-1562be7a896e tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:17.830336 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-52f4d695-3274-4326-8d4c-1562be7a896e tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:18.023428 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-52f4d695-3274-4326-8d4c-1562be7a896e tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1efac6c215148ce8c3ecdce1e9a8742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d392a7d77f46fcb4faa017786796fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:20:18.030781 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-52f4d695-3274-4326-8d4c-1562be7a896e tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] 10.222.0.66 "GET /compute/v2.1/servers/937d4958-6710-4c44-8451-2b659b87dc63" status: 200 len: 1520 microversion: 2.1 time: 0.222446 Nov 22 12:20:18.031397 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 106/190] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:20:17 2021] GET /compute/v2.1/servers/937d4958-6710-4c44-8451-2b659b87dc63 => generated 1520 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:20:18.818908 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-a7bf93c7-1cba-46e7-a32a-067c0411389e tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:20:18.820179 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-a7bf93c7-1cba-46e7-a32a-067c0411389e tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: c9f6d441-246f-479e-8e88-ea701c0f87ff] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:20:18.828975 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-a7bf93c7-1cba-46e7-a32a-067c0411389e tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:18.829456 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-a7bf93c7-1cba-46e7-a32a-067c0411389e tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:18.830200 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-a7bf93c7-1cba-46e7-a32a-067c0411389e tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:18.837410 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-a7bf93c7-1cba-46e7-a32a-067c0411389e tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:18.913023 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-a7bf93c7-1cba-46e7-a32a-067c0411389e tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "POST /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff/action" status: 200 len: 14 microversion: 2.20 time: 0.099354 Nov 22 12:20:18.914005 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 107/191] 10.222.0.66 () {62 vars in 1318 bytes} [Mon Nov 22 12:20:18 2021] POST /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff/action => generated 14 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 12:20:19.048949 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-dd81a97a-2c74-4f3e-ade3-a2ccac616aa9 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:20:19.049783 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-dd81a97a-2c74-4f3e-ade3-a2ccac616aa9 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] [instance: 937d4958-6710-4c44-8451-2b659b87dc63] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:20:19.065771 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-dd81a97a-2c74-4f3e-ade3-a2ccac616aa9 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:19.066219 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-dd81a97a-2c74-4f3e-ade3-a2ccac616aa9 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:19.067008 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-dd81a97a-2c74-4f3e-ade3-a2ccac616aa9 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:19.076483 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-dd81a97a-2c74-4f3e-ade3-a2ccac616aa9 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:19.345621 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-dd81a97a-2c74-4f3e-ade3-a2ccac616aa9 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1efac6c215148ce8c3ecdce1e9a8742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d392a7d77f46fcb4faa017786796fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:20:19.353517 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-dd81a97a-2c74-4f3e-ade3-a2ccac616aa9 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] 10.222.0.66 "GET /compute/v2.1/servers/937d4958-6710-4c44-8451-2b659b87dc63" status: 200 len: 1520 microversion: 2.1 time: 0.308944 Nov 22 12:20:19.364208 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 108/192] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:20:19 2021] GET /compute/v2.1/servers/937d4958-6710-4c44-8451-2b659b87dc63 => generated 1520 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:20:19.364208 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-bf6a6a74-cbbc-4226-9415-b2c68fd422a7 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-940805710", "imageRef": "31affc49-b6f0-44da-af65-4c65d72458b9", "flavorRef": "452", "networks": [{"uuid": "f0e4cddf-9054-45b8-ae14-fd837a61718e"}]}} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:20:23.117110 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.network.neutron [None req-5c9a631d-8bbc-4400-ae0b-6f49afa4a3f8 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] validate_networks() for [('1a398bbd-8494-4c78-9a7f-9328646aea45', None, None, None, None, None)] {{(pid=116273) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 22 12:20:23.139516 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.network.neutron [None req-bf6a6a74-cbbc-4226-9415-b2c68fd422a7 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] validate_networks() for [('f0e4cddf-9054-45b8-ae14-fd837a61718e', None, None, None, None, None)] {{(pid=116272) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 22 12:20:24.075853 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.virt.hardware [None req-bf6a6a74-cbbc-4226-9415-b2c68fd422a7 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Flavor limits 0:0:0 {{(pid=116272) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 22 12:20:24.076321 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.virt.hardware [None req-bf6a6a74-cbbc-4226-9415-b2c68fd422a7 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Image limits 0:0:0 {{(pid=116272) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 22 12:20:24.078425 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.virt.hardware [None req-bf6a6a74-cbbc-4226-9415-b2c68fd422a7 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Flavor pref 0:0:0 {{(pid=116272) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 22 12:20:24.078425 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.virt.hardware [None req-bf6a6a74-cbbc-4226-9415-b2c68fd422a7 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Image pref 0:0:0 {{(pid=116272) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 22 12:20:24.078425 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.virt.hardware [None req-bf6a6a74-cbbc-4226-9415-b2c68fd422a7 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116272) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 22 12:20:24.087648 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-bf6a6a74-cbbc-4226-9415-b2c68fd422a7 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:24.087873 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.virt.hardware [None req-5c9a631d-8bbc-4400-ae0b-6f49afa4a3f8 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Flavor limits 0:0:0 {{(pid=116273) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 22 12:20:24.088174 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-bf6a6a74-cbbc-4226-9415-b2c68fd422a7 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:24.088271 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.virt.hardware [None req-5c9a631d-8bbc-4400-ae0b-6f49afa4a3f8 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Image limits 0:0:0 {{(pid=116273) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 22 12:20:24.088808 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.virt.hardware [None req-5c9a631d-8bbc-4400-ae0b-6f49afa4a3f8 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Flavor pref 0:0:0 {{(pid=116273) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 22 12:20:24.089189 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-bf6a6a74-cbbc-4226-9415-b2c68fd422a7 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:24.089534 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.virt.hardware [None req-5c9a631d-8bbc-4400-ae0b-6f49afa4a3f8 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Image pref 0:0:0 {{(pid=116273) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 22 12:20:24.090063 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-bf6a6a74-cbbc-4226-9415-b2c68fd422a7 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:24.090229 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.virt.hardware [None req-5c9a631d-8bbc-4400-ae0b-6f49afa4a3f8 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116273) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 22 12:20:24.101362 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-5c9a631d-8bbc-4400-ae0b-6f49afa4a3f8 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:24.101847 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-5c9a631d-8bbc-4400-ae0b-6f49afa4a3f8 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:24.102645 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-5c9a631d-8bbc-4400-ae0b-6f49afa4a3f8 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:24.103079 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-5c9a631d-8bbc-4400-ae0b-6f49afa4a3f8 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:24.110823 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.quota [None req-bf6a6a74-cbbc-4226-9415-b2c68fd422a7 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Getting quotas for project 8dc74b1d74b14a009699279eb128f9f9. Resources: {'ram', 'instances', 'cores'} {{(pid=116272) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 22 12:20:24.114847 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.quota [None req-bf6a6a74-cbbc-4226-9415-b2c68fd422a7 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Getting quotas for user cc29a63c701941f9909e8235c80f5ce5 and project 8dc74b1d74b14a009699279eb128f9f9. Resources: {'ram', 'instances', 'cores'} {{(pid=116272) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 22 12:20:24.120632 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.quota [None req-5c9a631d-8bbc-4400-ae0b-6f49afa4a3f8 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Getting quotas for project 5319fd2dee9b4b47b98f59bca1572ac8. Resources: {'ram', 'instances', 'cores'} {{(pid=116273) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 22 12:20:24.126014 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.quota [None req-5c9a631d-8bbc-4400-ae0b-6f49afa4a3f8 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Getting quotas for user 8a4b581fa25045cea9585ae4e707585d and project 5319fd2dee9b4b47b98f59bca1572ac8. Resources: {'ram', 'instances', 'cores'} {{(pid=116273) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 22 12:20:24.126371 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-bf6a6a74-cbbc-4226-9415-b2c68fd422a7 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Going to run 1 instances... {{(pid=116272) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 22 12:20:24.129174 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-bf6a6a74-cbbc-4226-9415-b2c68fd422a7 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] [instance: a3624677-f35c-4a8c-ad79-990ee6987c7b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='31affc49-b6f0-44da-af65-4c65d72458b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116272) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 22 12:20:24.138768 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-5c9a631d-8bbc-4400-ae0b-6f49afa4a3f8 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Going to run 1 instances... {{(pid=116273) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 22 12:20:24.141340 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-5c9a631d-8bbc-4400-ae0b-6f49afa4a3f8 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] [instance: 8412ba15-56d4-416c-ade2-50b31de5ccb9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='31affc49-b6f0-44da-af65-4c65d72458b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116273) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 22 12:20:24.180883 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-bf6a6a74-cbbc-4226-9415-b2c68fd422a7 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.824993 Nov 22 12:20:24.182164 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 109/193] 10.222.0.66 () {60 vars in 1146 bytes} [Mon Nov 22 12:20:19 2021] POST /compute/v2.1/servers => generated 380 bytes in 4827 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 22 12:20:24.209775 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-5c9a631d-8bbc-4400-ae0b-6f49afa4a3f8 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 11.133644 Nov 22 12:20:24.215661 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 85/194] 10.222.0.66 () {60 vars in 1146 bytes} [Mon Nov 22 12:20:13 2021] POST /compute/v2.1/servers => generated 380 bytes in 11140 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 22 12:20:24.227443 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-4727b725-64c8-4b4d-925c-46f47bde06e4 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:20:24.228335 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-4727b725-64c8-4b4d-925c-46f47bde06e4 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: c9f6d441-246f-479e-8e88-ea701c0f87ff] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:20:24.235545 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-4727b725-64c8-4b4d-925c-46f47bde06e4 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:24.236196 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-4727b725-64c8-4b4d-925c-46f47bde06e4 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:24.237169 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-4727b725-64c8-4b4d-925c-46f47bde06e4 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:24.237751 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-4727b725-64c8-4b4d-925c-46f47bde06e4 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:24.389523 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-4727b725-64c8-4b4d-925c-46f47bde06e4 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "POST /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff/action" status: 200 len: 17602 microversion: 2.20 time: 0.172209 Nov 22 12:20:24.390090 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 86/195] 10.222.0.66 () {62 vars in 1318 bytes} [Mon Nov 22 12:20:24 2021] POST /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff/action => generated 17602 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 12:20:24.398592 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-ac5087d2-bc62-4515-ab98-782f77ec4532 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:20:24.399305 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-ac5087d2-bc62-4515-ab98-782f77ec4532 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] [instance: 937d4958-6710-4c44-8451-2b659b87dc63] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:20:24.413988 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-ac5087d2-bc62-4515-ab98-782f77ec4532 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:24.414445 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-ac5087d2-bc62-4515-ab98-782f77ec4532 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:24.419748 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-ac5087d2-bc62-4515-ab98-782f77ec4532 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:24.421251 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-ac5087d2-bc62-4515-ab98-782f77ec4532 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:24.470413 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-5d7e08c6-50ca-4140-b28f-44b66f7b2f5c tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Action: 'create', calling method: .version_select at 0x7fa1a3eb2940>, body: {"keypair": {"name": "tempest-keypair-940633463"}} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:20:24.510236 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.quota [None req-5d7e08c6-50ca-4140-b28f-44b66f7b2f5c tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Getting quotas for project 7f5dffe9bc3f41c7a2656d194fd02173. Resources: {'key_pairs'} {{(pid=116272) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 22 12:20:24.538210 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.quota [None req-5d7e08c6-50ca-4140-b28f-44b66f7b2f5c tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Getting quotas for user b41d885b9b854d8db11da5d325552301 and project 7f5dffe9bc3f41c7a2656d194fd02173. Resources: {'key_pairs'} {{(pid=116272) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 22 12:20:24.670902 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-ac5087d2-bc62-4515-ab98-782f77ec4532 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1efac6c215148ce8c3ecdce1e9a8742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d392a7d77f46fcb4faa017786796fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:20:24.684643 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-ac5087d2-bc62-4515-ab98-782f77ec4532 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] 10.222.0.66 "GET /compute/v2.1/servers/937d4958-6710-4c44-8451-2b659b87dc63" status: 200 len: 1520 microversion: 2.1 time: 0.289968 Nov 22 12:20:24.685964 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 87/196] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:20:24 2021] GET /compute/v2.1/servers/937d4958-6710-4c44-8451-2b659b87dc63 => generated 1520 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:20:24.701468 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-58746603-c08f-4865-8ecf-efc96de11e9c tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:20:24.702516 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-58746603-c08f-4865-8ecf-efc96de11e9c tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] [instance: a3624677-f35c-4a8c-ad79-990ee6987c7b] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:20:24.763168 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-58746603-c08f-4865-8ecf-efc96de11e9c tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc29a63c701941f9909e8235c80f5ce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc74b1d74b14a009699279eb128f9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:20:24.769384 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.quota [None req-5d7e08c6-50ca-4140-b28f-44b66f7b2f5c tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Getting quotas for project 7f5dffe9bc3f41c7a2656d194fd02173. Resources: {'key_pairs'} {{(pid=116272) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 22 12:20:24.773018 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-58746603-c08f-4865-8ecf-efc96de11e9c tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] 10.222.0.66 "GET /compute/v2.1/servers/a3624677-f35c-4a8c-ad79-990ee6987c7b" status: 200 len: 1218 microversion: 2.1 time: 0.085557 Nov 22 12:20:24.774977 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 88/197] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:20:24 2021] GET /compute/v2.1/servers/a3624677-f35c-4a8c-ad79-990ee6987c7b => generated 1218 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:20:24.781343 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-81adc21d-0ec7-4c62-b468-ed4c4de5b13f tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:20:24.782156 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-81adc21d-0ec7-4c62-b468-ed4c4de5b13f tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] [instance: 8412ba15-56d4-416c-ade2-50b31de5ccb9] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:20:24.783977 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.quota [None req-5d7e08c6-50ca-4140-b28f-44b66f7b2f5c tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Getting quotas for user b41d885b9b854d8db11da5d325552301 and project 7f5dffe9bc3f41c7a2656d194fd02173. Resources: {'key_pairs'} {{(pid=116272) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 22 12:20:24.802421 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-5d7e08c6-50ca-4140-b28f-44b66f7b2f5c tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 0.619034 Nov 22 12:20:24.803268 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 110/198] 10.222.0.66 () {60 vars in 1157 bytes} [Mon Nov 22 12:20:24 2021] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:20:24.869647 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-81adc21d-0ec7-4c62-b468-ed4c4de5b13f tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b581fa25045cea9585ae4e707585d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5319fd2dee9b4b47b98f59bca1572ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:20:24.880251 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-81adc21d-0ec7-4c62-b468-ed4c4de5b13f tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] 10.222.0.66 "GET /compute/v2.1/servers/8412ba15-56d4-416c-ade2-50b31de5ccb9" status: 200 len: 1217 microversion: 2.1 time: 0.103287 Nov 22 12:20:24.881248 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 89/199] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:20:24 2021] GET /compute/v2.1/servers/8412ba15-56d4-416c-ade2-50b31de5ccb9 => generated 1217 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:20:25.400989 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-3f201132-9558-49a1-b0f1-60ce99685577 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:20:25.401981 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-3f201132-9558-49a1-b0f1-60ce99685577 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: c9f6d441-246f-479e-8e88-ea701c0f87ff] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:20:25.409942 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-3f201132-9558-49a1-b0f1-60ce99685577 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:25.410774 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-3f201132-9558-49a1-b0f1-60ce99685577 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:25.412297 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-3f201132-9558-49a1-b0f1-60ce99685577 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:25.413003 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-3f201132-9558-49a1-b0f1-60ce99685577 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:25.513077 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-3f201132-9558-49a1-b0f1-60ce99685577 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "POST /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff/action" status: 200 len: 17602 microversion: 2.20 time: 0.115881 Nov 22 12:20:25.515008 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 111/200] 10.222.0.66 () {62 vars in 1318 bytes} [Mon Nov 22 12:20:25 2021] POST /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff/action => generated 17602 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 12:20:25.708520 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-8d3aefe4-1003-4b05-99b9-3196dae36489 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:20:25.709765 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-8d3aefe4-1003-4b05-99b9-3196dae36489 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] [instance: 937d4958-6710-4c44-8451-2b659b87dc63] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:20:25.731368 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-8d3aefe4-1003-4b05-99b9-3196dae36489 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:25.735085 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-8d3aefe4-1003-4b05-99b9-3196dae36489 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:25.736062 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-8d3aefe4-1003-4b05-99b9-3196dae36489 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:25.736515 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-8d3aefe4-1003-4b05-99b9-3196dae36489 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:25.794226 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-1d36be52-3ecd-4877-a26c-558a69c14f10 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:20:25.795055 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-1d36be52-3ecd-4877-a26c-558a69c14f10 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] [instance: a3624677-f35c-4a8c-ad79-990ee6987c7b] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:20:25.807171 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-1d36be52-3ecd-4877-a26c-558a69c14f10 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:25.811952 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-1d36be52-3ecd-4877-a26c-558a69c14f10 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:25.813945 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-1d36be52-3ecd-4877-a26c-558a69c14f10 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:25.816189 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-1d36be52-3ecd-4877-a26c-558a69c14f10 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:25.929026 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-1d36be52-3ecd-4877-a26c-558a69c14f10 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc29a63c701941f9909e8235c80f5ce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc74b1d74b14a009699279eb128f9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:20:25.938928 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-1d36be52-3ecd-4877-a26c-558a69c14f10 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] 10.222.0.66 "GET /compute/v2.1/servers/a3624677-f35c-4a8c-ad79-990ee6987c7b" status: 200 len: 1288 microversion: 2.1 time: 0.150251 Nov 22 12:20:25.943973 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 112/201] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:20:25 2021] GET /compute/v2.1/servers/a3624677-f35c-4a8c-ad79-990ee6987c7b => generated 1288 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:20:25.949279 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-a5c9a2e8-9b04-4ace-b9c4-6ec0abf3e3bc tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:20:25.949859 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-a5c9a2e8-9b04-4ace-b9c4-6ec0abf3e3bc tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] [instance: 8412ba15-56d4-416c-ade2-50b31de5ccb9] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:20:25.957400 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-a5c9a2e8-9b04-4ace-b9c4-6ec0abf3e3bc tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:25.957845 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-a5c9a2e8-9b04-4ace-b9c4-6ec0abf3e3bc tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:25.958634 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-a5c9a2e8-9b04-4ace-b9c4-6ec0abf3e3bc tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:25.959258 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-a5c9a2e8-9b04-4ace-b9c4-6ec0abf3e3bc tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:26.063371 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-a5c9a2e8-9b04-4ace-b9c4-6ec0abf3e3bc tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b581fa25045cea9585ae4e707585d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5319fd2dee9b4b47b98f59bca1572ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:20:26.071131 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-a5c9a2e8-9b04-4ace-b9c4-6ec0abf3e3bc tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] 10.222.0.66 "GET /compute/v2.1/servers/8412ba15-56d4-416c-ade2-50b31de5ccb9" status: 200 len: 1269 microversion: 2.1 time: 0.125822 Nov 22 12:20:26.071934 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 113/202] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:20:25 2021] GET /compute/v2.1/servers/8412ba15-56d4-416c-ade2-50b31de5ccb9 => generated 1269 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:20:26.079966 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-8d3aefe4-1003-4b05-99b9-3196dae36489 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1efac6c215148ce8c3ecdce1e9a8742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d392a7d77f46fcb4faa017786796fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:20:26.090019 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-8d3aefe4-1003-4b05-99b9-3196dae36489 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] 10.222.0.66 "GET /compute/v2.1/servers/937d4958-6710-4c44-8451-2b659b87dc63" status: 200 len: 1520 microversion: 2.1 time: 0.391033 Nov 22 12:20:26.092964 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 90/203] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:20:25 2021] GET /compute/v2.1/servers/937d4958-6710-4c44-8451-2b659b87dc63 => generated 1520 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:20:26.525813 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-42f12936-3a07-42f4-bbd9-2e5a2ec1d720 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:20:26.527522 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-42f12936-3a07-42f4-bbd9-2e5a2ec1d720 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: c9f6d441-246f-479e-8e88-ea701c0f87ff] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:20:26.539382 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-42f12936-3a07-42f4-bbd9-2e5a2ec1d720 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:26.542143 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-42f12936-3a07-42f4-bbd9-2e5a2ec1d720 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:26.543271 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-42f12936-3a07-42f4-bbd9-2e5a2ec1d720 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:26.545108 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-32b0e388-5a4e-4086-817b-7547642bb6b8 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1933451823", "imageRef": "31affc49-b6f0-44da-af65-4c65d72458b9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "10b712e1-1243-4ece-87db-2201cf5a5198"}], "security_groups": [{"name": "tempest-securitygroup--1584808884"}], "key_name": "tempest-keypair-940633463", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:20:26.545864 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-42f12936-3a07-42f4-bbd9-2e5a2ec1d720 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:26.669544 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-42f12936-3a07-42f4-bbd9-2e5a2ec1d720 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "POST /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff/action" status: 200 len: 18399 microversion: 2.20 time: 0.138445 Nov 22 12:20:26.669544 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 114/204] 10.222.0.66 () {62 vars in 1318 bytes} [Mon Nov 22 12:20:26 2021] POST /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff/action => generated 18399 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 12:20:26.753605 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.network.neutron [None req-32b0e388-5a4e-4086-817b-7547642bb6b8 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] validate_networks() for [('10b712e1-1243-4ece-87db-2201cf5a5198', None, None, None, None, None)] {{(pid=116273) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 22 12:20:26.960425 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-f33e5736-b491-4747-8f8c-a1e7e9bdb76a tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:20:26.961475 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-f33e5736-b491-4747-8f8c-a1e7e9bdb76a tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] [instance: a3624677-f35c-4a8c-ad79-990ee6987c7b] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:20:26.969014 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-f33e5736-b491-4747-8f8c-a1e7e9bdb76a tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:26.969788 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-f33e5736-b491-4747-8f8c-a1e7e9bdb76a tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:26.970672 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-f33e5736-b491-4747-8f8c-a1e7e9bdb76a tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:26.971513 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-f33e5736-b491-4747-8f8c-a1e7e9bdb76a tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:27.363643 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-f33e5736-b491-4747-8f8c-a1e7e9bdb76a tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc29a63c701941f9909e8235c80f5ce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc74b1d74b14a009699279eb128f9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:20:27.372815 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-f33e5736-b491-4747-8f8c-a1e7e9bdb76a tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] 10.222.0.66 "GET /compute/v2.1/servers/a3624677-f35c-4a8c-ad79-990ee6987c7b" status: 200 len: 1318 microversion: 2.1 time: 0.416137 Nov 22 12:20:27.379781 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 115/205] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:20:26 2021] GET /compute/v2.1/servers/a3624677-f35c-4a8c-ad79-990ee6987c7b => generated 1318 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 12:20:27.386262 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-ebe56bfe-f0c7-481d-93eb-510acd4a2b7f tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:20:27.387734 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-ebe56bfe-f0c7-481d-93eb-510acd4a2b7f tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] [instance: 8412ba15-56d4-416c-ade2-50b31de5ccb9] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:20:27.395424 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-ebe56bfe-f0c7-481d-93eb-510acd4a2b7f tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:27.395878 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-ebe56bfe-f0c7-481d-93eb-510acd4a2b7f tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:27.396809 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-ebe56bfe-f0c7-481d-93eb-510acd4a2b7f tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:27.397476 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-ebe56bfe-f0c7-481d-93eb-510acd4a2b7f tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:27.674591 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.virt.hardware [None req-32b0e388-5a4e-4086-817b-7547642bb6b8 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Flavor limits 0:0:0 {{(pid=116273) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 22 12:20:27.675245 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.virt.hardware [None req-32b0e388-5a4e-4086-817b-7547642bb6b8 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Image limits 0:0:0 {{(pid=116273) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 22 12:20:27.676048 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.virt.hardware [None req-32b0e388-5a4e-4086-817b-7547642bb6b8 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Flavor pref 0:0:0 {{(pid=116273) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 22 12:20:27.676659 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.virt.hardware [None req-32b0e388-5a4e-4086-817b-7547642bb6b8 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Image pref 0:0:0 {{(pid=116273) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 22 12:20:27.677128 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.virt.hardware [None req-32b0e388-5a4e-4086-817b-7547642bb6b8 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116273) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 22 12:20:27.686667 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-32b0e388-5a4e-4086-817b-7547642bb6b8 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:27.687255 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-32b0e388-5a4e-4086-817b-7547642bb6b8 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:27.688161 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-32b0e388-5a4e-4086-817b-7547642bb6b8 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:27.688800 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-32b0e388-5a4e-4086-817b-7547642bb6b8 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:27.708821 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.quota [None req-32b0e388-5a4e-4086-817b-7547642bb6b8 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Getting quotas for project 7f5dffe9bc3f41c7a2656d194fd02173. Resources: {'ram', 'instances', 'cores'} {{(pid=116273) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 22 12:20:27.713788 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.quota [None req-32b0e388-5a4e-4086-817b-7547642bb6b8 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Getting quotas for user b41d885b9b854d8db11da5d325552301 and project 7f5dffe9bc3f41c7a2656d194fd02173. Resources: {'ram', 'instances', 'cores'} {{(pid=116273) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 22 12:20:27.726671 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-32b0e388-5a4e-4086-817b-7547642bb6b8 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Going to run 1 instances... {{(pid=116273) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 22 12:20:27.729030 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-32b0e388-5a4e-4086-817b-7547642bb6b8 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: 2306113c-8f98-42fd-8c0c-3dfac98fff21] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='31affc49-b6f0-44da-af65-4c65d72458b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116273) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 22 12:20:27.763281 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-ebe56bfe-f0c7-481d-93eb-510acd4a2b7f tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b581fa25045cea9585ae4e707585d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5319fd2dee9b4b47b98f59bca1572ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:20:27.776464 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-ebe56bfe-f0c7-481d-93eb-510acd4a2b7f tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] 10.222.0.66 "GET /compute/v2.1/servers/8412ba15-56d4-416c-ade2-50b31de5ccb9" status: 200 len: 1317 microversion: 2.1 time: 0.394042 Nov 22 12:20:27.780071 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-32b0e388-5a4e-4086-817b-7547642bb6b8 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.243577 Nov 22 12:20:27.781706 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 91/206] 10.222.0.66 () {60 vars in 1146 bytes} [Mon Nov 22 12:20:26 2021] POST /compute/v2.1/servers => generated 402 bytes in 1247 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 22 12:20:27.786532 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-33a660bc-fc12-4d60-a833-8cc355491010 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:20:27.787609 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-33a660bc-fc12-4d60-a833-8cc355491010 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] [instance: 937d4958-6710-4c44-8451-2b659b87dc63] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:20:27.794013 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-33a660bc-fc12-4d60-a833-8cc355491010 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:27.794186 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 116/207] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:20:27 2021] GET /compute/v2.1/servers/8412ba15-56d4-416c-ade2-50b31de5ccb9 => generated 1317 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:20:27.794590 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-33a660bc-fc12-4d60-a833-8cc355491010 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:27.795749 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-33a660bc-fc12-4d60-a833-8cc355491010 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:27.796309 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-33a660bc-fc12-4d60-a833-8cc355491010 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:27.807257 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-c40d5358-b646-4a82-ac9c-4c08e30a3e11 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:20:27.812993 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-c40d5358-b646-4a82-ac9c-4c08e30a3e11 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: c9f6d441-246f-479e-8e88-ea701c0f87ff] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:20:27.842903 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-c40d5358-b646-4a82-ac9c-4c08e30a3e11 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:27.843388 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-c40d5358-b646-4a82-ac9c-4c08e30a3e11 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:27.849430 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-c40d5358-b646-4a82-ac9c-4c08e30a3e11 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:27.856741 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-c40d5358-b646-4a82-ac9c-4c08e30a3e11 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:28.086411 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-33a660bc-fc12-4d60-a833-8cc355491010 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1efac6c215148ce8c3ecdce1e9a8742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d392a7d77f46fcb4faa017786796fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:20:28.097938 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-33a660bc-fc12-4d60-a833-8cc355491010 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] 10.222.0.66 "GET /compute/v2.1/servers/937d4958-6710-4c44-8451-2b659b87dc63" status: 200 len: 1520 microversion: 2.1 time: 0.314679 Nov 22 12:20:28.098678 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 92/208] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:20:27 2021] GET /compute/v2.1/servers/937d4958-6710-4c44-8451-2b659b87dc63 => generated 1520 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:20:28.104366 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-c6b180e1-dbb7-4bc3-b129-a8c6ae455f1d tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:20:28.105252 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-c6b180e1-dbb7-4bc3-b129-a8c6ae455f1d tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: 2306113c-8f98-42fd-8c0c-3dfac98fff21] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:20:28.160494 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-c6b180e1-dbb7-4bc3-b129-a8c6ae455f1d tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41d885b9b854d8db11da5d325552301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f5dffe9bc3f41c7a2656d194fd02173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:20:28.167692 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-c6b180e1-dbb7-4bc3-b129-a8c6ae455f1d tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "GET /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21" status: 200 len: 1237 microversion: 2.1 time: 0.067407 Nov 22 12:20:28.168269 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 93/209] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:20:28 2021] GET /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21 => generated 1237 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:20:28.173137 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [req-aa3e11d6-4789-47fb-9054-39e35c9d600c req-267bac99-cc5b-440f-ad10-48a222527ccf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8412ba15-56d4-416c-ade2-50b31de5ccb9", "tag": "0b5d6d5e-e442-4681-83aa-fb04b4fc7ce4"}]} {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:20:28.174704 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 12:20:28.174704 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: warnings.warn(msg) Nov 22 12:20:28.181811 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [req-aa3e11d6-4789-47fb-9054-39e35c9d600c req-267bac99-cc5b-440f-ad10-48a222527ccf service nova] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:28.182521 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [req-aa3e11d6-4789-47fb-9054-39e35c9d600c req-267bac99-cc5b-440f-ad10-48a222527ccf service nova] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:28.194367 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.compute.server_external_events [req-aa3e11d6-4789-47fb-9054-39e35c9d600c req-267bac99-cc5b-440f-ad10-48a222527ccf service nova] Creating event network-changed:0b5d6d5e-e442-4681-83aa-fb04b4fc7ce4 for instance 8412ba15-56d4-416c-ade2-50b31de5ccb9 on hv-cinder-76845 Nov 22 12:20:28.199785 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [req-aa3e11d6-4789-47fb-9054-39e35c9d600c req-267bac99-cc5b-440f-ad10-48a222527ccf service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030171 Nov 22 12:20:28.200269 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 94/210] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Nov 22 12:20:28 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 12:20:28.205327 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [req-931bff75-ebc3-484d-accd-cd4748a38244 req-328666b2-52f7-457a-b624-bc15b063f11b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3624677-f35c-4a8c-ad79-990ee6987c7b", "tag": "2dd5ed5d-5998-4e11-8d38-8460b3dd3760"}]} {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:20:28.206813 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 12:20:28.206813 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: warnings.warn(msg) Nov 22 12:20:28.213924 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [req-931bff75-ebc3-484d-accd-cd4748a38244 req-328666b2-52f7-457a-b624-bc15b063f11b service nova] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:28.214379 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [req-931bff75-ebc3-484d-accd-cd4748a38244 req-328666b2-52f7-457a-b624-bc15b063f11b service nova] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:28.226783 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.compute.server_external_events [req-931bff75-ebc3-484d-accd-cd4748a38244 req-328666b2-52f7-457a-b624-bc15b063f11b service nova] Creating event network-changed:2dd5ed5d-5998-4e11-8d38-8460b3dd3760 for instance a3624677-f35c-4a8c-ad79-990ee6987c7b on hv-cinder-76845 Nov 22 12:20:28.232004 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [req-931bff75-ebc3-484d-accd-cd4748a38244 req-328666b2-52f7-457a-b624-bc15b063f11b service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030353 Nov 22 12:20:28.232824 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 95/211] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Nov 22 12:20:28 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 12:20:28.391222 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-e806f163-2517-4a2b-89ed-c03a818d4dfb tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:20:28.391875 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-e806f163-2517-4a2b-89ed-c03a818d4dfb tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] [instance: a3624677-f35c-4a8c-ad79-990ee6987c7b] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:20:28.398688 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-e806f163-2517-4a2b-89ed-c03a818d4dfb tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:28.399124 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-e806f163-2517-4a2b-89ed-c03a818d4dfb tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:28.399970 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-e806f163-2517-4a2b-89ed-c03a818d4dfb tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:28.400644 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-e806f163-2517-4a2b-89ed-c03a818d4dfb tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:28.555861 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-e806f163-2517-4a2b-89ed-c03a818d4dfb tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc29a63c701941f9909e8235c80f5ce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc74b1d74b14a009699279eb128f9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:20:28.565359 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-e806f163-2517-4a2b-89ed-c03a818d4dfb tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] 10.222.0.66 "GET /compute/v2.1/servers/a3624677-f35c-4a8c-ad79-990ee6987c7b" status: 200 len: 1318 microversion: 2.1 time: 0.178683 Nov 22 12:20:28.565949 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 96/212] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:20:28 2021] GET /compute/v2.1/servers/a3624677-f35c-4a8c-ad79-990ee6987c7b => generated 1318 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 12:20:28.811420 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-ed64b4bf-d3a3-457b-9135-d714b18b0844 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:20:28.812115 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-ed64b4bf-d3a3-457b-9135-d714b18b0844 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] [instance: 8412ba15-56d4-416c-ade2-50b31de5ccb9] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:20:28.818802 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-ed64b4bf-d3a3-457b-9135-d714b18b0844 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:28.819288 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-ed64b4bf-d3a3-457b-9135-d714b18b0844 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:28.820375 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-ed64b4bf-d3a3-457b-9135-d714b18b0844 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:28.820831 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-ed64b4bf-d3a3-457b-9135-d714b18b0844 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:28.974348 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-ed64b4bf-d3a3-457b-9135-d714b18b0844 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b581fa25045cea9585ae4e707585d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5319fd2dee9b4b47b98f59bca1572ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:20:28.983885 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-ed64b4bf-d3a3-457b-9135-d714b18b0844 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] 10.222.0.66 "GET /compute/v2.1/servers/8412ba15-56d4-416c-ade2-50b31de5ccb9" status: 200 len: 1317 microversion: 2.1 time: 0.175807 Nov 22 12:20:28.984835 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 97/213] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:20:28 2021] GET /compute/v2.1/servers/8412ba15-56d4-416c-ade2-50b31de5ccb9 => generated 1317 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:20:29.116170 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-dfe6a0cf-74b0-40c0-a172-7331adc7bc4f tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:20:29.116774 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-dfe6a0cf-74b0-40c0-a172-7331adc7bc4f tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] [instance: 937d4958-6710-4c44-8451-2b659b87dc63] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:20:29.123810 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-dfe6a0cf-74b0-40c0-a172-7331adc7bc4f tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:29.124359 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-dfe6a0cf-74b0-40c0-a172-7331adc7bc4f tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:29.125164 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-dfe6a0cf-74b0-40c0-a172-7331adc7bc4f tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:29.125601 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-dfe6a0cf-74b0-40c0-a172-7331adc7bc4f tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:29.272255 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-dfe6a0cf-74b0-40c0-a172-7331adc7bc4f tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1efac6c215148ce8c3ecdce1e9a8742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d392a7d77f46fcb4faa017786796fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:20:29.282520 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-dfe6a0cf-74b0-40c0-a172-7331adc7bc4f tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] 10.222.0.66 "GET /compute/v2.1/servers/937d4958-6710-4c44-8451-2b659b87dc63" status: 200 len: 1520 microversion: 2.1 time: 0.170181 Nov 22 12:20:29.283095 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 98/214] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:20:29 2021] GET /compute/v2.1/servers/937d4958-6710-4c44-8451-2b659b87dc63 => generated 1520 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:20:29.287806 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-39f69e20-a994-4d2c-a3dd-97fc921423c2 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:20:29.288404 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-39f69e20-a994-4d2c-a3dd-97fc921423c2 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: 2306113c-8f98-42fd-8c0c-3dfac98fff21] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:20:29.295024 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-39f69e20-a994-4d2c-a3dd-97fc921423c2 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:29.295828 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-39f69e20-a994-4d2c-a3dd-97fc921423c2 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:29.296613 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-39f69e20-a994-4d2c-a3dd-97fc921423c2 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:29.297074 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-39f69e20-a994-4d2c-a3dd-97fc921423c2 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:29.355296 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-39f69e20-a994-4d2c-a3dd-97fc921423c2 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41d885b9b854d8db11da5d325552301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f5dffe9bc3f41c7a2656d194fd02173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:20:29.363183 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-39f69e20-a994-4d2c-a3dd-97fc921423c2 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "GET /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21" status: 200 len: 1241 microversion: 2.1 time: 0.079028 Nov 22 12:20:29.363792 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 99/215] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:20:29 2021] GET /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21 => generated 1241 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:20:29.585035 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-0fd41e35-cfb9-4dc6-b339-b8d9ccf943c9 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:20:29.585902 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-0fd41e35-cfb9-4dc6-b339-b8d9ccf943c9 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] [instance: a3624677-f35c-4a8c-ad79-990ee6987c7b] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:20:29.594557 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-0fd41e35-cfb9-4dc6-b339-b8d9ccf943c9 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:29.594974 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-0fd41e35-cfb9-4dc6-b339-b8d9ccf943c9 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:29.595809 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-0fd41e35-cfb9-4dc6-b339-b8d9ccf943c9 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:29.596219 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-0fd41e35-cfb9-4dc6-b339-b8d9ccf943c9 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:29.737656 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-0fd41e35-cfb9-4dc6-b339-b8d9ccf943c9 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc29a63c701941f9909e8235c80f5ce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc74b1d74b14a009699279eb128f9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:20:29.745948 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-0fd41e35-cfb9-4dc6-b339-b8d9ccf943c9 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] 10.222.0.66 "GET /compute/v2.1/servers/a3624677-f35c-4a8c-ad79-990ee6987c7b" status: 200 len: 1318 microversion: 2.1 time: 0.166376 Nov 22 12:20:29.746470 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 100/216] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:20:29 2021] GET /compute/v2.1/servers/a3624677-f35c-4a8c-ad79-990ee6987c7b => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:20:30.001469 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-41759598-2aa3-407c-8ef7-dca3a0d84004 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:20:30.002082 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-41759598-2aa3-407c-8ef7-dca3a0d84004 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] [instance: 8412ba15-56d4-416c-ade2-50b31de5ccb9] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:20:30.008702 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-41759598-2aa3-407c-8ef7-dca3a0d84004 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:30.009186 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-41759598-2aa3-407c-8ef7-dca3a0d84004 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:30.010036 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-41759598-2aa3-407c-8ef7-dca3a0d84004 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:30.010493 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-41759598-2aa3-407c-8ef7-dca3a0d84004 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:30.153104 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-41759598-2aa3-407c-8ef7-dca3a0d84004 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b581fa25045cea9585ae4e707585d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5319fd2dee9b4b47b98f59bca1572ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:20:30.164143 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-41759598-2aa3-407c-8ef7-dca3a0d84004 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] 10.222.0.66 "GET /compute/v2.1/servers/8412ba15-56d4-416c-ade2-50b31de5ccb9" status: 200 len: 1317 microversion: 2.1 time: 0.166208 Nov 22 12:20:30.164989 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 101/217] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:20:29 2021] GET /compute/v2.1/servers/8412ba15-56d4-416c-ade2-50b31de5ccb9 => generated 1317 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:20:30.300785 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-ece1b692-d3ca-4fdb-ae4d-86c31038ca2f tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:20:30.302731 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-ece1b692-d3ca-4fdb-ae4d-86c31038ca2f tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] [instance: 937d4958-6710-4c44-8451-2b659b87dc63] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:20:30.310038 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-ece1b692-d3ca-4fdb-ae4d-86c31038ca2f tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:30.310475 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-ece1b692-d3ca-4fdb-ae4d-86c31038ca2f tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:30.311480 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-ece1b692-d3ca-4fdb-ae4d-86c31038ca2f tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:30.312048 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-ece1b692-d3ca-4fdb-ae4d-86c31038ca2f tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:30.645663 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-ece1b692-d3ca-4fdb-ae4d-86c31038ca2f tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1efac6c215148ce8c3ecdce1e9a8742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d392a7d77f46fcb4faa017786796fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:20:30.659321 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-ece1b692-d3ca-4fdb-ae4d-86c31038ca2f tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] 10.222.0.66 "GET /compute/v2.1/servers/937d4958-6710-4c44-8451-2b659b87dc63" status: 200 len: 1520 microversion: 2.1 time: 0.362220 Nov 22 12:20:30.660172 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 102/218] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:20:30 2021] GET /compute/v2.1/servers/937d4958-6710-4c44-8451-2b659b87dc63 => generated 1520 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:20:30.666967 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-8ad65f2d-54d7-4c23-b4e9-4937463f66c2 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:20:30.667920 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-8ad65f2d-54d7-4c23-b4e9-4937463f66c2 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: 2306113c-8f98-42fd-8c0c-3dfac98fff21] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:20:30.674731 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-8ad65f2d-54d7-4c23-b4e9-4937463f66c2 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:30.675182 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-8ad65f2d-54d7-4c23-b4e9-4937463f66c2 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:30.675985 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-8ad65f2d-54d7-4c23-b4e9-4937463f66c2 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:30.676419 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-8ad65f2d-54d7-4c23-b4e9-4937463f66c2 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:30.736231 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-8ad65f2d-54d7-4c23-b4e9-4937463f66c2 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41d885b9b854d8db11da5d325552301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f5dffe9bc3f41c7a2656d194fd02173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:20:30.744003 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-8ad65f2d-54d7-4c23-b4e9-4937463f66c2 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "GET /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21" status: 200 len: 1241 microversion: 2.1 time: 0.082743 Nov 22 12:20:30.744592 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 103/219] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:20:30 2021] GET /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21 => generated 1241 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:20:30.762920 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-44aeb79c-989d-419c-a7b8-f39ae06c2b53 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:20:30.763547 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-44aeb79c-989d-419c-a7b8-f39ae06c2b53 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] [instance: a3624677-f35c-4a8c-ad79-990ee6987c7b] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:20:30.770553 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-44aeb79c-989d-419c-a7b8-f39ae06c2b53 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:30.771003 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-44aeb79c-989d-419c-a7b8-f39ae06c2b53 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:30.771791 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-44aeb79c-989d-419c-a7b8-f39ae06c2b53 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:30.772214 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-44aeb79c-989d-419c-a7b8-f39ae06c2b53 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:30.913003 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-44aeb79c-989d-419c-a7b8-f39ae06c2b53 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc29a63c701941f9909e8235c80f5ce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc74b1d74b14a009699279eb128f9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:20:30.921837 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-44aeb79c-989d-419c-a7b8-f39ae06c2b53 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] 10.222.0.66 "GET /compute/v2.1/servers/a3624677-f35c-4a8c-ad79-990ee6987c7b" status: 200 len: 1318 microversion: 2.1 time: 0.162496 Nov 22 12:20:30.922486 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 104/220] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:20:30 2021] GET /compute/v2.1/servers/a3624677-f35c-4a8c-ad79-990ee6987c7b => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:20:31.186506 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-e4c75ad9-b028-41fe-8736-f822bc6a43ea tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:20:31.188155 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-e4c75ad9-b028-41fe-8736-f822bc6a43ea tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] [instance: 8412ba15-56d4-416c-ade2-50b31de5ccb9] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:20:31.198352 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-c40d5358-b646-4a82-ac9c-4c08e30a3e11 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "POST /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff/action" status: 200 len: 24589 microversion: 2.20 time: 3.402865 Nov 22 12:20:31.200136 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 117/221] 10.222.0.66 () {62 vars in 1318 bytes} [Mon Nov 22 12:20:27 2021] POST /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff/action => generated 24589 bytes in 3405 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 12:20:31.201342 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-e4c75ad9-b028-41fe-8736-f822bc6a43ea tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:31.202262 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-e4c75ad9-b028-41fe-8736-f822bc6a43ea tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:31.203275 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-e4c75ad9-b028-41fe-8736-f822bc6a43ea tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:31.204054 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-e4c75ad9-b028-41fe-8736-f822bc6a43ea tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:31.581780 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-e4c75ad9-b028-41fe-8736-f822bc6a43ea tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b581fa25045cea9585ae4e707585d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5319fd2dee9b4b47b98f59bca1572ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:20:31.589799 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-e4c75ad9-b028-41fe-8736-f822bc6a43ea tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] 10.222.0.66 "GET /compute/v2.1/servers/8412ba15-56d4-416c-ade2-50b31de5ccb9" status: 200 len: 1317 microversion: 2.1 time: 0.407450 Nov 22 12:20:31.590743 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 105/222] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:20:31 2021] GET /compute/v2.1/servers/8412ba15-56d4-416c-ade2-50b31de5ccb9 => generated 1317 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 12:20:31.681532 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-7e3e094a-649b-4c9c-a996-8e17724e0a1c tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:20:31.682550 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-7e3e094a-649b-4c9c-a996-8e17724e0a1c tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] [instance: 937d4958-6710-4c44-8451-2b659b87dc63] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:20:31.690847 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-7e3e094a-649b-4c9c-a996-8e17724e0a1c tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:31.691262 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-7e3e094a-649b-4c9c-a996-8e17724e0a1c tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:31.692072 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-7e3e094a-649b-4c9c-a996-8e17724e0a1c tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:31.692509 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-7e3e094a-649b-4c9c-a996-8e17724e0a1c tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:31.760748 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-5a77c82a-08a7-4ed8-b8af-ddec1fc68f59 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:20:31.761359 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-5a77c82a-08a7-4ed8-b8af-ddec1fc68f59 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: 2306113c-8f98-42fd-8c0c-3dfac98fff21] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:20:31.768737 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-5a77c82a-08a7-4ed8-b8af-ddec1fc68f59 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:31.769134 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-5a77c82a-08a7-4ed8-b8af-ddec1fc68f59 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:31.769915 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-5a77c82a-08a7-4ed8-b8af-ddec1fc68f59 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:31.770327 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-5a77c82a-08a7-4ed8-b8af-ddec1fc68f59 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:31.879057 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-5a77c82a-08a7-4ed8-b8af-ddec1fc68f59 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41d885b9b854d8db11da5d325552301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f5dffe9bc3f41c7a2656d194fd02173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:20:31.888331 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-5a77c82a-08a7-4ed8-b8af-ddec1fc68f59 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "GET /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21" status: 200 len: 1289 microversion: 2.1 time: 0.131086 Nov 22 12:20:31.889593 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 106/223] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:20:31 2021] GET /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21 => generated 1289 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:20:31.941175 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-7aa85cb2-d2e8-4fd8-80a4-02250b80173d tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:20:31.942093 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-7aa85cb2-d2e8-4fd8-80a4-02250b80173d tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] [instance: a3624677-f35c-4a8c-ad79-990ee6987c7b] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:20:31.949176 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-7aa85cb2-d2e8-4fd8-80a4-02250b80173d tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:31.949993 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-7aa85cb2-d2e8-4fd8-80a4-02250b80173d tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:31.950931 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-7aa85cb2-d2e8-4fd8-80a4-02250b80173d tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:31.951604 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-7aa85cb2-d2e8-4fd8-80a4-02250b80173d tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:31.957034 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-7e3e094a-649b-4c9c-a996-8e17724e0a1c tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1efac6c215148ce8c3ecdce1e9a8742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d392a7d77f46fcb4faa017786796fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:20:31.965201 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-7e3e094a-649b-4c9c-a996-8e17724e0a1c tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] 10.222.0.66 "GET /compute/v2.1/servers/937d4958-6710-4c44-8451-2b659b87dc63" status: 200 len: 1520 microversion: 2.1 time: 0.287796 Nov 22 12:20:31.965783 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 118/224] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:20:31 2021] GET /compute/v2.1/servers/937d4958-6710-4c44-8451-2b659b87dc63 => generated 1520 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:20:32.195085 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-7aa85cb2-d2e8-4fd8-80a4-02250b80173d tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc29a63c701941f9909e8235c80f5ce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc74b1d74b14a009699279eb128f9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:20:32.206573 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-7aa85cb2-d2e8-4fd8-80a4-02250b80173d tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] 10.222.0.66 "GET /compute/v2.1/servers/a3624677-f35c-4a8c-ad79-990ee6987c7b" status: 200 len: 1318 microversion: 2.1 time: 0.268701 Nov 22 12:20:32.210158 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-495ce4c7-495e-4d0b-b332-a057abb7e801 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:20:32.211204 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-495ce4c7-495e-4d0b-b332-a057abb7e801 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: c9f6d441-246f-479e-8e88-ea701c0f87ff] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:20:32.212746 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 107/225] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:20:31 2021] GET /compute/v2.1/servers/a3624677-f35c-4a8c-ad79-990ee6987c7b => generated 1318 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:20:32.220514 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-495ce4c7-495e-4d0b-b332-a057abb7e801 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:32.220967 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-495ce4c7-495e-4d0b-b332-a057abb7e801 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:32.221887 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-495ce4c7-495e-4d0b-b332-a057abb7e801 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:32.223509 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-495ce4c7-495e-4d0b-b332-a057abb7e801 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:32.323160 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-495ce4c7-495e-4d0b-b332-a057abb7e801 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "POST /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff/action" status: 200 len: 25281 microversion: 2.20 time: 0.116578 Nov 22 12:20:32.325411 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 119/226] 10.222.0.66 () {62 vars in 1318 bytes} [Mon Nov 22 12:20:32 2021] POST /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff/action => generated 25281 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 22 12:20:32.607111 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-fe96cc1f-e166-49ed-a017-4ab3deda8235 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:20:32.607894 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-fe96cc1f-e166-49ed-a017-4ab3deda8235 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] [instance: 8412ba15-56d4-416c-ade2-50b31de5ccb9] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:20:32.613857 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-fe96cc1f-e166-49ed-a017-4ab3deda8235 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:32.614304 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-fe96cc1f-e166-49ed-a017-4ab3deda8235 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:32.615129 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-fe96cc1f-e166-49ed-a017-4ab3deda8235 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:32.615601 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-fe96cc1f-e166-49ed-a017-4ab3deda8235 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:32.755015 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-fe96cc1f-e166-49ed-a017-4ab3deda8235 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b581fa25045cea9585ae4e707585d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5319fd2dee9b4b47b98f59bca1572ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:20:32.763197 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-fe96cc1f-e166-49ed-a017-4ab3deda8235 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] 10.222.0.66 "GET /compute/v2.1/servers/8412ba15-56d4-416c-ade2-50b31de5ccb9" status: 200 len: 1317 microversion: 2.1 time: 0.159665 Nov 22 12:20:32.764237 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 108/227] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:20:32 2021] GET /compute/v2.1/servers/8412ba15-56d4-416c-ade2-50b31de5ccb9 => generated 1317 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:20:32.906403 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-86c36beb-7211-486d-a126-4e9f1f25ba56 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:20:32.907210 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-86c36beb-7211-486d-a126-4e9f1f25ba56 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: 2306113c-8f98-42fd-8c0c-3dfac98fff21] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:20:32.915826 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-86c36beb-7211-486d-a126-4e9f1f25ba56 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:32.916647 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-86c36beb-7211-486d-a126-4e9f1f25ba56 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:32.917638 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-86c36beb-7211-486d-a126-4e9f1f25ba56 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:32.918273 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-86c36beb-7211-486d-a126-4e9f1f25ba56 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:32.982247 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-720d0cc8-12a5-44fe-a938-bd21c75e8933 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:20:32.982991 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-720d0cc8-12a5-44fe-a938-bd21c75e8933 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] [instance: 937d4958-6710-4c44-8451-2b659b87dc63] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:20:32.990607 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-720d0cc8-12a5-44fe-a938-bd21c75e8933 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:32.991061 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-720d0cc8-12a5-44fe-a938-bd21c75e8933 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:32.992030 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-720d0cc8-12a5-44fe-a938-bd21c75e8933 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:32.992467 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-720d0cc8-12a5-44fe-a938-bd21c75e8933 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:33.118913 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-86c36beb-7211-486d-a126-4e9f1f25ba56 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41d885b9b854d8db11da5d325552301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f5dffe9bc3f41c7a2656d194fd02173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:20:33.133923 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-86c36beb-7211-486d-a126-4e9f1f25ba56 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "GET /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21" status: 200 len: 1363 microversion: 2.1 time: 0.232092 Nov 22 12:20:33.135085 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 120/228] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:20:32 2021] GET /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21 => generated 1363 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:20:33.199044 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-720d0cc8-12a5-44fe-a938-bd21c75e8933 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1efac6c215148ce8c3ecdce1e9a8742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d392a7d77f46fcb4faa017786796fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:20:33.207754 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-720d0cc8-12a5-44fe-a938-bd21c75e8933 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] 10.222.0.66 "GET /compute/v2.1/servers/937d4958-6710-4c44-8451-2b659b87dc63" status: 200 len: 1520 microversion: 2.1 time: 0.229273 Nov 22 12:20:33.208576 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 109/229] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:20:32 2021] GET /compute/v2.1/servers/937d4958-6710-4c44-8451-2b659b87dc63 => generated 1520 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:20:33.229148 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-ce527e0d-df70-40ed-9c4c-92bb41529abb tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:20:33.229768 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-ce527e0d-df70-40ed-9c4c-92bb41529abb tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] [instance: a3624677-f35c-4a8c-ad79-990ee6987c7b] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:20:33.237086 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-ce527e0d-df70-40ed-9c4c-92bb41529abb tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:33.237528 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-ce527e0d-df70-40ed-9c4c-92bb41529abb tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:33.238578 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-ce527e0d-df70-40ed-9c4c-92bb41529abb tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:33.239521 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-ce527e0d-df70-40ed-9c4c-92bb41529abb tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:33.337966 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-f2ff41b3-cd96-4ca0-8761-c0d0e773074e tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:20:33.338730 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-f2ff41b3-cd96-4ca0-8761-c0d0e773074e tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: c9f6d441-246f-479e-8e88-ea701c0f87ff] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:20:33.345227 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-f2ff41b3-cd96-4ca0-8761-c0d0e773074e tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:33.345684 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-f2ff41b3-cd96-4ca0-8761-c0d0e773074e tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:33.346717 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-f2ff41b3-cd96-4ca0-8761-c0d0e773074e tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:33.347419 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-f2ff41b3-cd96-4ca0-8761-c0d0e773074e tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:33.405799 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-ce527e0d-df70-40ed-9c4c-92bb41529abb tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc29a63c701941f9909e8235c80f5ce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc74b1d74b14a009699279eb128f9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:20:33.413851 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-ce527e0d-df70-40ed-9c4c-92bb41529abb tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] 10.222.0.66 "GET /compute/v2.1/servers/a3624677-f35c-4a8c-ad79-990ee6987c7b" status: 200 len: 1318 microversion: 2.1 time: 0.188429 Nov 22 12:20:33.414438 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 121/230] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:20:33 2021] GET /compute/v2.1/servers/a3624677-f35c-4a8c-ad79-990ee6987c7b => generated 1318 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:20:33.742048 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [req-8b677a6b-5a62-4d01-abb0-9a02f2ff16e0 req-d62daa91-16c0-49b5-9e8a-cf3cc5e99ba4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2306113c-8f98-42fd-8c0c-3dfac98fff21", "tag": "0b19f5ef-ff09-43ae-866e-7b3d6c9fc45c"}]} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:20:33.743692 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 12:20:33.743692 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: warnings.warn(msg) Nov 22 12:20:33.751600 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [req-8b677a6b-5a62-4d01-abb0-9a02f2ff16e0 req-d62daa91-16c0-49b5-9e8a-cf3cc5e99ba4 service nova] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:33.752037 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [req-8b677a6b-5a62-4d01-abb0-9a02f2ff16e0 req-d62daa91-16c0-49b5-9e8a-cf3cc5e99ba4 service nova] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:33.777987 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.compute.server_external_events [req-8b677a6b-5a62-4d01-abb0-9a02f2ff16e0 req-d62daa91-16c0-49b5-9e8a-cf3cc5e99ba4 service nova] Creating event network-changed:0b19f5ef-ff09-43ae-866e-7b3d6c9fc45c for instance 2306113c-8f98-42fd-8c0c-3dfac98fff21 on hv-cinder-76845 Nov 22 12:20:33.787387 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [req-8b677a6b-5a62-4d01-abb0-9a02f2ff16e0 req-d62daa91-16c0-49b5-9e8a-cf3cc5e99ba4 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048376 Nov 22 12:20:33.788782 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 122/231] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Nov 22 12:20:33 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 12:20:33.800016 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-89476d22-65d6-499c-b9c9-220f9543b0f3 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:20:33.800566 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-89476d22-65d6-499c-b9c9-220f9543b0f3 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] [instance: 8412ba15-56d4-416c-ade2-50b31de5ccb9] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:20:33.811788 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-89476d22-65d6-499c-b9c9-220f9543b0f3 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:33.812480 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-89476d22-65d6-499c-b9c9-220f9543b0f3 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:33.813881 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-89476d22-65d6-499c-b9c9-220f9543b0f3 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:33.814666 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-89476d22-65d6-499c-b9c9-220f9543b0f3 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:34.002530 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-89476d22-65d6-499c-b9c9-220f9543b0f3 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b581fa25045cea9585ae4e707585d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5319fd2dee9b4b47b98f59bca1572ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:20:34.010389 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-89476d22-65d6-499c-b9c9-220f9543b0f3 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] 10.222.0.66 "GET /compute/v2.1/servers/8412ba15-56d4-416c-ade2-50b31de5ccb9" status: 200 len: 1317 microversion: 2.1 time: 0.219730 Nov 22 12:20:34.010969 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 123/232] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:20:33 2021] GET /compute/v2.1/servers/8412ba15-56d4-416c-ade2-50b31de5ccb9 => generated 1317 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:20:34.152207 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-f68d7b49-a88b-4dbd-8612-2a3b299f0056 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:20:34.152814 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-f68d7b49-a88b-4dbd-8612-2a3b299f0056 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: 2306113c-8f98-42fd-8c0c-3dfac98fff21] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:20:34.159831 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-f68d7b49-a88b-4dbd-8612-2a3b299f0056 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:34.160277 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-f68d7b49-a88b-4dbd-8612-2a3b299f0056 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:34.161066 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-f68d7b49-a88b-4dbd-8612-2a3b299f0056 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:34.161495 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-f68d7b49-a88b-4dbd-8612-2a3b299f0056 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:34.309209 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-f68d7b49-a88b-4dbd-8612-2a3b299f0056 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41d885b9b854d8db11da5d325552301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f5dffe9bc3f41c7a2656d194fd02173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:20:34.317026 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-f68d7b49-a88b-4dbd-8612-2a3b299f0056 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "GET /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21" status: 200 len: 1363 microversion: 2.1 time: 0.168536 Nov 22 12:20:34.317600 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 124/233] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:20:34 2021] GET /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21 => generated 1363 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:20:34.321954 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-401880c2-dd2b-427c-b969-fa7df195677b tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:20:34.322552 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-401880c2-dd2b-427c-b969-fa7df195677b tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] [instance: 937d4958-6710-4c44-8451-2b659b87dc63] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:20:34.329157 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-401880c2-dd2b-427c-b969-fa7df195677b tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:34.329608 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-401880c2-dd2b-427c-b969-fa7df195677b tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:34.330395 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-401880c2-dd2b-427c-b969-fa7df195677b tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:34.330826 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-401880c2-dd2b-427c-b969-fa7df195677b tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:34.472453 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-401880c2-dd2b-427c-b969-fa7df195677b tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1efac6c215148ce8c3ecdce1e9a8742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d392a7d77f46fcb4faa017786796fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:20:34.481959 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-401880c2-dd2b-427c-b969-fa7df195677b tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] 10.222.0.66 "GET /compute/v2.1/servers/937d4958-6710-4c44-8451-2b659b87dc63" status: 200 len: 1520 microversion: 2.1 time: 0.163303 Nov 22 12:20:34.482532 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 125/234] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:20:34 2021] GET /compute/v2.1/servers/937d4958-6710-4c44-8451-2b659b87dc63 => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:20:34.491456 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-37720cd0-6fa0-4876-b25c-8e0166bf3677 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:20:34.492075 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-37720cd0-6fa0-4876-b25c-8e0166bf3677 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] [instance: a3624677-f35c-4a8c-ad79-990ee6987c7b] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:20:34.498609 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-37720cd0-6fa0-4876-b25c-8e0166bf3677 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:34.499039 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-37720cd0-6fa0-4876-b25c-8e0166bf3677 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:34.500042 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-37720cd0-6fa0-4876-b25c-8e0166bf3677 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:34.500479 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-37720cd0-6fa0-4876-b25c-8e0166bf3677 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:34.644641 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-37720cd0-6fa0-4876-b25c-8e0166bf3677 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc29a63c701941f9909e8235c80f5ce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc74b1d74b14a009699279eb128f9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:20:34.656742 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-37720cd0-6fa0-4876-b25c-8e0166bf3677 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] 10.222.0.66 "GET /compute/v2.1/servers/a3624677-f35c-4a8c-ad79-990ee6987c7b" status: 200 len: 1318 microversion: 2.1 time: 0.172964 Nov 22 12:20:34.657332 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 126/235] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:20:34 2021] GET /compute/v2.1/servers/a3624677-f35c-4a8c-ad79-990ee6987c7b => generated 1318 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:20:35.028524 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-d8858e9f-a2ad-4727-89ec-c33a471cf092 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:20:35.029229 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-d8858e9f-a2ad-4727-89ec-c33a471cf092 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] [instance: 8412ba15-56d4-416c-ade2-50b31de5ccb9] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:20:35.036458 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-d8858e9f-a2ad-4727-89ec-c33a471cf092 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:35.036918 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-d8858e9f-a2ad-4727-89ec-c33a471cf092 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:35.038014 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-d8858e9f-a2ad-4727-89ec-c33a471cf092 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:35.038448 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-d8858e9f-a2ad-4727-89ec-c33a471cf092 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:35.180818 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-d8858e9f-a2ad-4727-89ec-c33a471cf092 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b581fa25045cea9585ae4e707585d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5319fd2dee9b4b47b98f59bca1572ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:20:35.192406 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-d8858e9f-a2ad-4727-89ec-c33a471cf092 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] 10.222.0.66 "GET /compute/v2.1/servers/8412ba15-56d4-416c-ade2-50b31de5ccb9" status: 200 len: 1317 microversion: 2.1 time: 0.168217 Nov 22 12:20:35.193362 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 127/236] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:20:35 2021] GET /compute/v2.1/servers/8412ba15-56d4-416c-ade2-50b31de5ccb9 => generated 1317 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:20:35.339591 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-0fa6a7a1-72ab-40a8-852f-f0f12308f434 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:20:35.340242 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-0fa6a7a1-72ab-40a8-852f-f0f12308f434 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: 2306113c-8f98-42fd-8c0c-3dfac98fff21] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:20:35.348091 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-0fa6a7a1-72ab-40a8-852f-f0f12308f434 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:35.348539 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-0fa6a7a1-72ab-40a8-852f-f0f12308f434 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:35.349313 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-0fa6a7a1-72ab-40a8-852f-f0f12308f434 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:35.349743 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-0fa6a7a1-72ab-40a8-852f-f0f12308f434 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:35.505457 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-0fa6a7a1-72ab-40a8-852f-f0f12308f434 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41d885b9b854d8db11da5d325552301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f5dffe9bc3f41c7a2656d194fd02173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:20:35.514613 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-0fa6a7a1-72ab-40a8-852f-f0f12308f434 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "GET /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21" status: 200 len: 1363 microversion: 2.1 time: 0.180564 Nov 22 12:20:35.515593 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 128/237] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:20:35 2021] GET /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21 => generated 1363 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:20:35.520067 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-e0dab238-5799-45d8-9125-fc8235ae1e67 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:20:35.520664 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-e0dab238-5799-45d8-9125-fc8235ae1e67 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] [instance: 937d4958-6710-4c44-8451-2b659b87dc63] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:20:35.526984 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-e0dab238-5799-45d8-9125-fc8235ae1e67 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:35.527476 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-e0dab238-5799-45d8-9125-fc8235ae1e67 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:35.528271 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-e0dab238-5799-45d8-9125-fc8235ae1e67 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:35.528707 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-e0dab238-5799-45d8-9125-fc8235ae1e67 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:35.685497 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-e0dab238-5799-45d8-9125-fc8235ae1e67 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1efac6c215148ce8c3ecdce1e9a8742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d392a7d77f46fcb4faa017786796fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:20:35.694405 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-e0dab238-5799-45d8-9125-fc8235ae1e67 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] 10.222.0.66 "GET /compute/v2.1/servers/937d4958-6710-4c44-8451-2b659b87dc63" status: 200 len: 1520 microversion: 2.1 time: 0.177708 Nov 22 12:20:35.694901 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 129/238] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:20:35 2021] GET /compute/v2.1/servers/937d4958-6710-4c44-8451-2b659b87dc63 => generated 1520 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:20:35.699218 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-ca49d657-74af-47bb-97b4-266a91c17d4a tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:20:35.699854 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-ca49d657-74af-47bb-97b4-266a91c17d4a tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] [instance: a3624677-f35c-4a8c-ad79-990ee6987c7b] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:20:35.706874 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-ca49d657-74af-47bb-97b4-266a91c17d4a tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:35.707360 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-ca49d657-74af-47bb-97b4-266a91c17d4a tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:35.708144 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-ca49d657-74af-47bb-97b4-266a91c17d4a tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:35.708570 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-ca49d657-74af-47bb-97b4-266a91c17d4a tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:35.847850 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-ca49d657-74af-47bb-97b4-266a91c17d4a tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc29a63c701941f9909e8235c80f5ce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc74b1d74b14a009699279eb128f9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:20:35.857331 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-ca49d657-74af-47bb-97b4-266a91c17d4a tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] 10.222.0.66 "GET /compute/v2.1/servers/a3624677-f35c-4a8c-ad79-990ee6987c7b" status: 200 len: 1318 microversion: 2.1 time: 0.161438 Nov 22 12:20:35.858211 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 130/239] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:20:35 2021] GET /compute/v2.1/servers/a3624677-f35c-4a8c-ad79-990ee6987c7b => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:20:36.213431 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-cec65e10-daa1-4139-92db-011737c98969 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:20:36.214037 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-cec65e10-daa1-4139-92db-011737c98969 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] [instance: 8412ba15-56d4-416c-ade2-50b31de5ccb9] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:20:36.221536 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-cec65e10-daa1-4139-92db-011737c98969 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:36.221984 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-cec65e10-daa1-4139-92db-011737c98969 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:36.222755 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-cec65e10-daa1-4139-92db-011737c98969 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:36.223159 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-cec65e10-daa1-4139-92db-011737c98969 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:36.372712 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-cec65e10-daa1-4139-92db-011737c98969 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b581fa25045cea9585ae4e707585d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5319fd2dee9b4b47b98f59bca1572ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:20:36.380944 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-cec65e10-daa1-4139-92db-011737c98969 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] 10.222.0.66 "GET /compute/v2.1/servers/8412ba15-56d4-416c-ade2-50b31de5ccb9" status: 200 len: 1317 microversion: 2.1 time: 0.171143 Nov 22 12:20:36.381540 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 131/240] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:20:36 2021] GET /compute/v2.1/servers/8412ba15-56d4-416c-ade2-50b31de5ccb9 => generated 1317 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:20:36.534046 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-a9f2a3cd-26a8-4648-9fee-80cea2ad50fe tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:20:36.534800 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-a9f2a3cd-26a8-4648-9fee-80cea2ad50fe tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: 2306113c-8f98-42fd-8c0c-3dfac98fff21] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:20:36.543796 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-a9f2a3cd-26a8-4648-9fee-80cea2ad50fe tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:36.544340 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-a9f2a3cd-26a8-4648-9fee-80cea2ad50fe tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:36.545364 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-a9f2a3cd-26a8-4648-9fee-80cea2ad50fe tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:36.546538 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-a9f2a3cd-26a8-4648-9fee-80cea2ad50fe tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:36.680964 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-a9f2a3cd-26a8-4648-9fee-80cea2ad50fe tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41d885b9b854d8db11da5d325552301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f5dffe9bc3f41c7a2656d194fd02173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:20:36.689057 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-a9f2a3cd-26a8-4648-9fee-80cea2ad50fe tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "GET /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21" status: 200 len: 1363 microversion: 2.1 time: 0.160021 Nov 22 12:20:36.689631 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 132/241] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:20:36 2021] GET /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21 => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 12:20:36.710715 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-47c2fd83-6763-4768-a81f-6ddf2a053ff8 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:20:36.711349 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-47c2fd83-6763-4768-a81f-6ddf2a053ff8 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] [instance: 937d4958-6710-4c44-8451-2b659b87dc63] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:20:36.718653 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-47c2fd83-6763-4768-a81f-6ddf2a053ff8 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:36.719107 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-47c2fd83-6763-4768-a81f-6ddf2a053ff8 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:36.719928 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-47c2fd83-6763-4768-a81f-6ddf2a053ff8 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:36.720369 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-47c2fd83-6763-4768-a81f-6ddf2a053ff8 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:36.863175 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-47c2fd83-6763-4768-a81f-6ddf2a053ff8 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1efac6c215148ce8c3ecdce1e9a8742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d392a7d77f46fcb4faa017786796fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:20:36.870767 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-47c2fd83-6763-4768-a81f-6ddf2a053ff8 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] 10.222.0.66 "GET /compute/v2.1/servers/937d4958-6710-4c44-8451-2b659b87dc63" status: 200 len: 1520 microversion: 2.1 time: 0.163652 Nov 22 12:20:36.871838 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 133/242] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:20:36 2021] GET /compute/v2.1/servers/937d4958-6710-4c44-8451-2b659b87dc63 => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:20:36.875636 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-31598082-f1fd-4292-8b85-ee9047a223ba tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:20:36.876235 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-31598082-f1fd-4292-8b85-ee9047a223ba tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] [instance: a3624677-f35c-4a8c-ad79-990ee6987c7b] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:20:36.882091 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-31598082-f1fd-4292-8b85-ee9047a223ba tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:36.882536 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-31598082-f1fd-4292-8b85-ee9047a223ba tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:36.883334 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-31598082-f1fd-4292-8b85-ee9047a223ba tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:36.883759 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-31598082-f1fd-4292-8b85-ee9047a223ba tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:36.903146 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-f2ff41b3-cd96-4ca0-8761-c0d0e773074e tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "POST /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff/action" status: 200 len: 27767 microversion: 2.20 time: 3.569768 Nov 22 12:20:36.903854 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 110/243] 10.222.0.66 () {62 vars in 1318 bytes} [Mon Nov 22 12:20:33 2021] POST /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff/action => generated 27767 bytes in 3571 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 22 12:20:37.018612 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-31598082-f1fd-4292-8b85-ee9047a223ba tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc29a63c701941f9909e8235c80f5ce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc74b1d74b14a009699279eb128f9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:20:37.026150 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-31598082-f1fd-4292-8b85-ee9047a223ba tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] 10.222.0.66 "GET /compute/v2.1/servers/a3624677-f35c-4a8c-ad79-990ee6987c7b" status: 200 len: 1318 microversion: 2.1 time: 0.153826 Nov 22 12:20:37.026705 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 134/244] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:20:36 2021] GET /compute/v2.1/servers/a3624677-f35c-4a8c-ad79-990ee6987c7b => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:20:37.398977 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-75ce86ae-c7dd-439c-8dac-7b33b0e3046f tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:20:37.399786 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-75ce86ae-c7dd-439c-8dac-7b33b0e3046f tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] [instance: 8412ba15-56d4-416c-ade2-50b31de5ccb9] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:20:37.406951 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-75ce86ae-c7dd-439c-8dac-7b33b0e3046f tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:37.407580 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-75ce86ae-c7dd-439c-8dac-7b33b0e3046f tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:37.408209 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-75ce86ae-c7dd-439c-8dac-7b33b0e3046f tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:37.408635 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-75ce86ae-c7dd-439c-8dac-7b33b0e3046f tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:37.546139 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-75ce86ae-c7dd-439c-8dac-7b33b0e3046f tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b581fa25045cea9585ae4e707585d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5319fd2dee9b4b47b98f59bca1572ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:20:37.557236 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-75ce86ae-c7dd-439c-8dac-7b33b0e3046f tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] 10.222.0.66 "GET /compute/v2.1/servers/8412ba15-56d4-416c-ade2-50b31de5ccb9" status: 200 len: 1317 microversion: 2.1 time: 0.162208 Nov 22 12:20:37.558247 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 111/245] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:20:37 2021] GET /compute/v2.1/servers/8412ba15-56d4-416c-ade2-50b31de5ccb9 => generated 1317 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:20:37.706630 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-b25772b0-99bd-488d-9767-fcd2273e0757 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:20:37.707267 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-b25772b0-99bd-488d-9767-fcd2273e0757 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: 2306113c-8f98-42fd-8c0c-3dfac98fff21] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:20:37.714907 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-b25772b0-99bd-488d-9767-fcd2273e0757 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:37.715396 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-b25772b0-99bd-488d-9767-fcd2273e0757 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:37.716199 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-b25772b0-99bd-488d-9767-fcd2273e0757 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:37.716635 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-b25772b0-99bd-488d-9767-fcd2273e0757 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:37.862700 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-b25772b0-99bd-488d-9767-fcd2273e0757 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41d885b9b854d8db11da5d325552301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f5dffe9bc3f41c7a2656d194fd02173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:20:37.870114 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-b25772b0-99bd-488d-9767-fcd2273e0757 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "GET /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21" status: 200 len: 1363 microversion: 2.1 time: 0.167692 Nov 22 12:20:37.870771 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 135/246] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:20:37 2021] GET /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21 => generated 1363 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:20:37.888280 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-b476347d-795d-4445-8862-3e9aa39e742d tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:20:37.888970 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-b476347d-795d-4445-8862-3e9aa39e742d tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] [instance: 937d4958-6710-4c44-8451-2b659b87dc63] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:20:37.895297 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-b476347d-795d-4445-8862-3e9aa39e742d tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:37.895750 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-b476347d-795d-4445-8862-3e9aa39e742d tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:37.896624 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-b476347d-795d-4445-8862-3e9aa39e742d tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:37.896963 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-b476347d-795d-4445-8862-3e9aa39e742d tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:37.915997 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-eed02ca1-7ccf-4b35-8e66-1948b7087bbf tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:20:37.917317 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-eed02ca1-7ccf-4b35-8e66-1948b7087bbf tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: c9f6d441-246f-479e-8e88-ea701c0f87ff] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:20:37.924060 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-eed02ca1-7ccf-4b35-8e66-1948b7087bbf tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:37.924609 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-eed02ca1-7ccf-4b35-8e66-1948b7087bbf tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:37.925745 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-eed02ca1-7ccf-4b35-8e66-1948b7087bbf tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:37.926272 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-eed02ca1-7ccf-4b35-8e66-1948b7087bbf tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:38.030160 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-eed02ca1-7ccf-4b35-8e66-1948b7087bbf tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "POST /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff/action" status: 200 len: 28177 microversion: 2.20 time: 0.118350 Nov 22 12:20:38.031011 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 136/247] 10.222.0.66 () {62 vars in 1318 bytes} [Mon Nov 22 12:20:37 2021] POST /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff/action => generated 28177 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 12:20:38.043944 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-62210293-6f6b-4d50-8aff-c420e18e03fa tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:20:38.044746 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-62210293-6f6b-4d50-8aff-c420e18e03fa tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] [instance: a3624677-f35c-4a8c-ad79-990ee6987c7b] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:20:38.052259 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-62210293-6f6b-4d50-8aff-c420e18e03fa tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:38.053033 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-62210293-6f6b-4d50-8aff-c420e18e03fa tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:38.054010 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-62210293-6f6b-4d50-8aff-c420e18e03fa tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:38.054493 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-62210293-6f6b-4d50-8aff-c420e18e03fa tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:38.064606 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-b476347d-795d-4445-8862-3e9aa39e742d tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1efac6c215148ce8c3ecdce1e9a8742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d392a7d77f46fcb4faa017786796fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:20:38.072536 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-b476347d-795d-4445-8862-3e9aa39e742d tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] 10.222.0.66 "GET /compute/v2.1/servers/937d4958-6710-4c44-8451-2b659b87dc63" status: 200 len: 1520 microversion: 2.1 time: 0.187957 Nov 22 12:20:38.073157 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 112/248] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:20:37 2021] GET /compute/v2.1/servers/937d4958-6710-4c44-8451-2b659b87dc63 => generated 1520 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:20:38.202733 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-62210293-6f6b-4d50-8aff-c420e18e03fa tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc29a63c701941f9909e8235c80f5ce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc74b1d74b14a009699279eb128f9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:20:38.210356 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-62210293-6f6b-4d50-8aff-c420e18e03fa tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] 10.222.0.66 "GET /compute/v2.1/servers/a3624677-f35c-4a8c-ad79-990ee6987c7b" status: 200 len: 1318 microversion: 2.1 time: 0.170460 Nov 22 12:20:38.210980 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 137/249] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:20:38 2021] GET /compute/v2.1/servers/a3624677-f35c-4a8c-ad79-990ee6987c7b => generated 1318 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:20:38.574002 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-dd3038ab-6e56-4b5d-a921-a9f490985337 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:20:38.574605 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-dd3038ab-6e56-4b5d-a921-a9f490985337 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] [instance: 8412ba15-56d4-416c-ade2-50b31de5ccb9] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:20:38.581687 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-dd3038ab-6e56-4b5d-a921-a9f490985337 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:38.582114 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-dd3038ab-6e56-4b5d-a921-a9f490985337 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:38.582934 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-dd3038ab-6e56-4b5d-a921-a9f490985337 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:38.583392 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-dd3038ab-6e56-4b5d-a921-a9f490985337 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:38.724717 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-dd3038ab-6e56-4b5d-a921-a9f490985337 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b581fa25045cea9585ae4e707585d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5319fd2dee9b4b47b98f59bca1572ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:20:38.737163 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-dd3038ab-6e56-4b5d-a921-a9f490985337 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] 10.222.0.66 "GET /compute/v2.1/servers/8412ba15-56d4-416c-ade2-50b31de5ccb9" status: 200 len: 1317 microversion: 2.1 time: 0.166804 Nov 22 12:20:38.737754 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 113/250] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:20:38 2021] GET /compute/v2.1/servers/8412ba15-56d4-416c-ade2-50b31de5ccb9 => generated 1317 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:20:38.886540 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-64ae717f-04e6-4445-b5aa-0360d953ce65 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:20:38.887333 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-64ae717f-04e6-4445-b5aa-0360d953ce65 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: 2306113c-8f98-42fd-8c0c-3dfac98fff21] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:20:38.894998 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-64ae717f-04e6-4445-b5aa-0360d953ce65 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:38.895501 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-64ae717f-04e6-4445-b5aa-0360d953ce65 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:38.896298 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-64ae717f-04e6-4445-b5aa-0360d953ce65 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:38.896750 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-64ae717f-04e6-4445-b5aa-0360d953ce65 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:39.042852 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-ecdaba43-cc5a-4cd8-ad32-ed52f72fdfac tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:20:39.044222 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-ecdaba43-cc5a-4cd8-ad32-ed52f72fdfac tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: c9f6d441-246f-479e-8e88-ea701c0f87ff] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:20:39.051574 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-ecdaba43-cc5a-4cd8-ad32-ed52f72fdfac tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:39.052399 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-ecdaba43-cc5a-4cd8-ad32-ed52f72fdfac tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:39.053341 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-ecdaba43-cc5a-4cd8-ad32-ed52f72fdfac tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:39.053923 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-ecdaba43-cc5a-4cd8-ad32-ed52f72fdfac tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:39.080062 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-64ae717f-04e6-4445-b5aa-0360d953ce65 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41d885b9b854d8db11da5d325552301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f5dffe9bc3f41c7a2656d194fd02173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:20:39.096199 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-64ae717f-04e6-4445-b5aa-0360d953ce65 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "GET /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21" status: 200 len: 1363 microversion: 2.1 time: 0.213212 Nov 22 12:20:39.111702 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 138/251] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:20:38 2021] GET /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21 => generated 1363 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 12:20:39.112623 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-4665fabd-2342-4907-a1d2-1e48379814be tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:20:39.113584 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-4665fabd-2342-4907-a1d2-1e48379814be tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] [instance: 937d4958-6710-4c44-8451-2b659b87dc63] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:20:39.120527 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-4665fabd-2342-4907-a1d2-1e48379814be tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:39.120972 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-4665fabd-2342-4907-a1d2-1e48379814be tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:39.121772 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-4665fabd-2342-4907-a1d2-1e48379814be tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:39.122283 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-4665fabd-2342-4907-a1d2-1e48379814be tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:39.134846 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-ecdaba43-cc5a-4cd8-ad32-ed52f72fdfac tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "POST /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff/action" status: 200 len: 28177 microversion: 2.20 time: 0.095389 Nov 22 12:20:39.136396 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 114/252] 10.222.0.66 () {62 vars in 1318 bytes} [Mon Nov 22 12:20:39 2021] POST /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff/action => generated 28177 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 22 12:20:39.229029 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-a68da1db-1567-4d6c-a759-51a813489719 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:20:39.230732 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-a68da1db-1567-4d6c-a759-51a813489719 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] [instance: a3624677-f35c-4a8c-ad79-990ee6987c7b] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:20:39.239435 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-a68da1db-1567-4d6c-a759-51a813489719 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:39.240295 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-a68da1db-1567-4d6c-a759-51a813489719 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:39.242100 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-a68da1db-1567-4d6c-a759-51a813489719 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:39.242762 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-a68da1db-1567-4d6c-a759-51a813489719 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:39.418185 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-4665fabd-2342-4907-a1d2-1e48379814be tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1efac6c215148ce8c3ecdce1e9a8742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d392a7d77f46fcb4faa017786796fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:20:39.429715 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-4665fabd-2342-4907-a1d2-1e48379814be tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] 10.222.0.66 "GET /compute/v2.1/servers/937d4958-6710-4c44-8451-2b659b87dc63" status: 200 len: 1520 microversion: 2.1 time: 0.320617 Nov 22 12:20:39.430811 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 139/253] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:20:39 2021] GET /compute/v2.1/servers/937d4958-6710-4c44-8451-2b659b87dc63 => generated 1520 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:20:39.477426 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-a68da1db-1567-4d6c-a759-51a813489719 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc29a63c701941f9909e8235c80f5ce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc74b1d74b14a009699279eb128f9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:20:39.496137 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-a68da1db-1567-4d6c-a759-51a813489719 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] 10.222.0.66 "GET /compute/v2.1/servers/a3624677-f35c-4a8c-ad79-990ee6987c7b" status: 200 len: 1318 microversion: 2.1 time: 0.271582 Nov 22 12:20:39.497401 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 115/254] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:20:39 2021] GET /compute/v2.1/servers/a3624677-f35c-4a8c-ad79-990ee6987c7b => generated 1318 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 12:20:39.755303 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-b6cbe6e0-821c-48ec-9507-95cea3370d43 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:20:39.755942 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-b6cbe6e0-821c-48ec-9507-95cea3370d43 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] [instance: 8412ba15-56d4-416c-ade2-50b31de5ccb9] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:20:39.762956 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-b6cbe6e0-821c-48ec-9507-95cea3370d43 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:39.763401 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-b6cbe6e0-821c-48ec-9507-95cea3370d43 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:39.764186 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-b6cbe6e0-821c-48ec-9507-95cea3370d43 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:39.765013 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-b6cbe6e0-821c-48ec-9507-95cea3370d43 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:39.912728 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-b6cbe6e0-821c-48ec-9507-95cea3370d43 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b581fa25045cea9585ae4e707585d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5319fd2dee9b4b47b98f59bca1572ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:20:39.921600 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-b6cbe6e0-821c-48ec-9507-95cea3370d43 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] 10.222.0.66 "GET /compute/v2.1/servers/8412ba15-56d4-416c-ade2-50b31de5ccb9" status: 200 len: 1317 microversion: 2.1 time: 0.169881 Nov 22 12:20:39.922188 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 140/255] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:20:39 2021] GET /compute/v2.1/servers/8412ba15-56d4-416c-ade2-50b31de5ccb9 => generated 1317 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:20:40.115355 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-9f20b29b-ebed-44be-b413-fb8508174bd0 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:20:40.115878 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-9f20b29b-ebed-44be-b413-fb8508174bd0 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: 2306113c-8f98-42fd-8c0c-3dfac98fff21] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:20:40.122861 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-9f20b29b-ebed-44be-b413-fb8508174bd0 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:40.123323 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-9f20b29b-ebed-44be-b413-fb8508174bd0 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:40.124298 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-9f20b29b-ebed-44be-b413-fb8508174bd0 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:40.124739 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-9f20b29b-ebed-44be-b413-fb8508174bd0 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:40.151366 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-4d3318b4-b582-4fb5-b04b-ea3c76d2f7f1 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:20:40.153090 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-4d3318b4-b582-4fb5-b04b-ea3c76d2f7f1 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: c9f6d441-246f-479e-8e88-ea701c0f87ff] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:20:40.163912 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-4d3318b4-b582-4fb5-b04b-ea3c76d2f7f1 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:40.164693 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-4d3318b4-b582-4fb5-b04b-ea3c76d2f7f1 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:40.166040 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-4d3318b4-b582-4fb5-b04b-ea3c76d2f7f1 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:40.166766 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-4d3318b4-b582-4fb5-b04b-ea3c76d2f7f1 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:40.267846 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-9f20b29b-ebed-44be-b413-fb8508174bd0 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41d885b9b854d8db11da5d325552301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f5dffe9bc3f41c7a2656d194fd02173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:20:40.275675 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-9f20b29b-ebed-44be-b413-fb8508174bd0 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "GET /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21" status: 200 len: 1363 microversion: 2.1 time: 0.163977 Nov 22 12:20:40.276256 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 116/256] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:20:40 2021] GET /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21 => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:20:40.449146 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-8ddfbd14-244b-487a-aeb2-9b0bfbf0ccb1 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:20:40.449726 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-8ddfbd14-244b-487a-aeb2-9b0bfbf0ccb1 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] [instance: 937d4958-6710-4c44-8451-2b659b87dc63] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:20:40.457264 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-8ddfbd14-244b-487a-aeb2-9b0bfbf0ccb1 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:40.457710 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-8ddfbd14-244b-487a-aeb2-9b0bfbf0ccb1 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:40.458495 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-8ddfbd14-244b-487a-aeb2-9b0bfbf0ccb1 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:40.458922 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-8ddfbd14-244b-487a-aeb2-9b0bfbf0ccb1 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:40.602448 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-8ddfbd14-244b-487a-aeb2-9b0bfbf0ccb1 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1efac6c215148ce8c3ecdce1e9a8742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d392a7d77f46fcb4faa017786796fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:20:40.611982 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-8ddfbd14-244b-487a-aeb2-9b0bfbf0ccb1 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] 10.222.0.66 "GET /compute/v2.1/servers/937d4958-6710-4c44-8451-2b659b87dc63" status: 200 len: 1520 microversion: 2.1 time: 0.166567 Nov 22 12:20:40.612565 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 117/257] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:20:40 2021] GET /compute/v2.1/servers/937d4958-6710-4c44-8451-2b659b87dc63 => generated 1520 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 12:20:40.616950 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-cbb46883-a077-45d1-af0c-01d0f5eb658f tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:20:40.617569 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-cbb46883-a077-45d1-af0c-01d0f5eb658f tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] [instance: a3624677-f35c-4a8c-ad79-990ee6987c7b] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:20:40.624149 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-cbb46883-a077-45d1-af0c-01d0f5eb658f tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:40.625163 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-cbb46883-a077-45d1-af0c-01d0f5eb658f tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:40.625969 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-cbb46883-a077-45d1-af0c-01d0f5eb658f tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:40.626407 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-cbb46883-a077-45d1-af0c-01d0f5eb658f tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:40.785837 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-cbb46883-a077-45d1-af0c-01d0f5eb658f tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc29a63c701941f9909e8235c80f5ce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc74b1d74b14a009699279eb128f9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:20:40.793700 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-cbb46883-a077-45d1-af0c-01d0f5eb658f tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] 10.222.0.66 "GET /compute/v2.1/servers/a3624677-f35c-4a8c-ad79-990ee6987c7b" status: 200 len: 1318 microversion: 2.1 time: 0.180155 Nov 22 12:20:40.794266 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 118/258] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:20:40 2021] GET /compute/v2.1/servers/a3624677-f35c-4a8c-ad79-990ee6987c7b => generated 1318 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:20:40.938244 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-e92698e5-0e8e-41d4-8015-59a96e7e7722 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:20:40.938753 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-e92698e5-0e8e-41d4-8015-59a96e7e7722 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] [instance: 8412ba15-56d4-416c-ade2-50b31de5ccb9] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:20:40.945680 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-e92698e5-0e8e-41d4-8015-59a96e7e7722 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:40.946119 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-e92698e5-0e8e-41d4-8015-59a96e7e7722 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:40.946901 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-e92698e5-0e8e-41d4-8015-59a96e7e7722 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:40.947357 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-e92698e5-0e8e-41d4-8015-59a96e7e7722 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:41.085281 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-e92698e5-0e8e-41d4-8015-59a96e7e7722 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b581fa25045cea9585ae4e707585d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5319fd2dee9b4b47b98f59bca1572ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:20:41.093895 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-e92698e5-0e8e-41d4-8015-59a96e7e7722 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] 10.222.0.66 "GET /compute/v2.1/servers/8412ba15-56d4-416c-ade2-50b31de5ccb9" status: 200 len: 1317 microversion: 2.1 time: 0.159257 Nov 22 12:20:41.094519 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 119/259] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:20:40 2021] GET /compute/v2.1/servers/8412ba15-56d4-416c-ade2-50b31de5ccb9 => generated 1317 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 12:20:41.293753 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-e9c7e7e9-43fe-496d-be19-75f6a7b82e48 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:20:41.294554 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-e9c7e7e9-43fe-496d-be19-75f6a7b82e48 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: 2306113c-8f98-42fd-8c0c-3dfac98fff21] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:20:41.302367 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-e9c7e7e9-43fe-496d-be19-75f6a7b82e48 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:41.302817 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-e9c7e7e9-43fe-496d-be19-75f6a7b82e48 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:41.303645 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-e9c7e7e9-43fe-496d-be19-75f6a7b82e48 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:41.304089 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-e9c7e7e9-43fe-496d-be19-75f6a7b82e48 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:41.444690 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-e9c7e7e9-43fe-496d-be19-75f6a7b82e48 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41d885b9b854d8db11da5d325552301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f5dffe9bc3f41c7a2656d194fd02173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:20:41.453706 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-e9c7e7e9-43fe-496d-be19-75f6a7b82e48 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "GET /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21" status: 200 len: 1363 microversion: 2.1 time: 0.163414 Nov 22 12:20:41.454311 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 120/260] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:20:41 2021] GET /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21 => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 12:20:41.629855 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-c6ce4e61-6664-4566-b029-48447603a726 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:20:41.630398 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-c6ce4e61-6664-4566-b029-48447603a726 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] [instance: 937d4958-6710-4c44-8451-2b659b87dc63] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:20:41.637079 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-c6ce4e61-6664-4566-b029-48447603a726 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:41.637527 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-c6ce4e61-6664-4566-b029-48447603a726 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:41.638318 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-c6ce4e61-6664-4566-b029-48447603a726 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:41.638752 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-c6ce4e61-6664-4566-b029-48447603a726 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:41.785676 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-c6ce4e61-6664-4566-b029-48447603a726 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1efac6c215148ce8c3ecdce1e9a8742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d392a7d77f46fcb4faa017786796fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:20:41.793497 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-c6ce4e61-6664-4566-b029-48447603a726 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] 10.222.0.66 "GET /compute/v2.1/servers/937d4958-6710-4c44-8451-2b659b87dc63" status: 200 len: 1520 microversion: 2.1 time: 0.167928 Nov 22 12:20:41.794083 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 121/261] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:20:41 2021] GET /compute/v2.1/servers/937d4958-6710-4c44-8451-2b659b87dc63 => generated 1520 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:20:41.809615 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-aabdd388-adbc-425b-8828-d8471fb729b7 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:20:41.810211 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-aabdd388-adbc-425b-8828-d8471fb729b7 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] [instance: a3624677-f35c-4a8c-ad79-990ee6987c7b] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:20:41.816297 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-aabdd388-adbc-425b-8828-d8471fb729b7 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:41.816738 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-aabdd388-adbc-425b-8828-d8471fb729b7 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:41.817528 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-aabdd388-adbc-425b-8828-d8471fb729b7 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:41.817950 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-aabdd388-adbc-425b-8828-d8471fb729b7 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:41.965389 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-aabdd388-adbc-425b-8828-d8471fb729b7 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc29a63c701941f9909e8235c80f5ce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc74b1d74b14a009699279eb128f9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:20:41.974885 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-aabdd388-adbc-425b-8828-d8471fb729b7 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] 10.222.0.66 "GET /compute/v2.1/servers/a3624677-f35c-4a8c-ad79-990ee6987c7b" status: 200 len: 1318 microversion: 2.1 time: 0.168791 Nov 22 12:20:41.975514 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 122/262] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:20:41 2021] GET /compute/v2.1/servers/a3624677-f35c-4a8c-ad79-990ee6987c7b => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 12:20:42.113953 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-26f5b43d-e68c-4941-a75a-146ac1e288e1 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:20:42.114551 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-26f5b43d-e68c-4941-a75a-146ac1e288e1 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] [instance: 8412ba15-56d4-416c-ade2-50b31de5ccb9] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:20:42.120927 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-26f5b43d-e68c-4941-a75a-146ac1e288e1 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:42.121370 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-26f5b43d-e68c-4941-a75a-146ac1e288e1 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:42.122153 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-26f5b43d-e68c-4941-a75a-146ac1e288e1 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:42.122578 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-26f5b43d-e68c-4941-a75a-146ac1e288e1 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:42.271978 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-26f5b43d-e68c-4941-a75a-146ac1e288e1 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b581fa25045cea9585ae4e707585d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5319fd2dee9b4b47b98f59bca1572ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:20:42.282052 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-26f5b43d-e68c-4941-a75a-146ac1e288e1 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] 10.222.0.66 "GET /compute/v2.1/servers/8412ba15-56d4-416c-ade2-50b31de5ccb9" status: 200 len: 1317 microversion: 2.1 time: 0.171720 Nov 22 12:20:42.282626 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 123/263] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:20:42 2021] GET /compute/v2.1/servers/8412ba15-56d4-416c-ade2-50b31de5ccb9 => generated 1317 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:20:42.469928 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-e69aae5a-423a-4ec4-b866-5cb02b7939ec tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:20:42.470540 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-e69aae5a-423a-4ec4-b866-5cb02b7939ec tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: 2306113c-8f98-42fd-8c0c-3dfac98fff21] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:20:42.476828 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-e69aae5a-423a-4ec4-b866-5cb02b7939ec tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:42.477283 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-e69aae5a-423a-4ec4-b866-5cb02b7939ec tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:42.478189 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-e69aae5a-423a-4ec4-b866-5cb02b7939ec tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:42.478774 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-e69aae5a-423a-4ec4-b866-5cb02b7939ec tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:42.530587 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-4d3318b4-b582-4fb5-b04b-ea3c76d2f7f1 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "POST /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff/action" status: 200 len: 28177 microversion: 2.20 time: 2.385861 Nov 22 12:20:42.531875 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 141/264] 10.222.0.66 () {62 vars in 1318 bytes} [Mon Nov 22 12:20:40 2021] POST /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff/action => generated 28177 bytes in 2389 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 12:20:42.642015 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-e69aae5a-423a-4ec4-b866-5cb02b7939ec tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41d885b9b854d8db11da5d325552301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f5dffe9bc3f41c7a2656d194fd02173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:20:42.654589 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-e69aae5a-423a-4ec4-b866-5cb02b7939ec tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "GET /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21" status: 200 len: 1363 microversion: 2.1 time: 0.188407 Nov 22 12:20:42.655784 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 124/265] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:20:42 2021] GET /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21 => generated 1363 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:20:42.813238 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-5bd93163-6a3a-4abf-8263-78dd4fed7049 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:20:42.813956 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-5bd93163-6a3a-4abf-8263-78dd4fed7049 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] [instance: 937d4958-6710-4c44-8451-2b659b87dc63] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:20:42.821812 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-5bd93163-6a3a-4abf-8263-78dd4fed7049 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:42.822458 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-5bd93163-6a3a-4abf-8263-78dd4fed7049 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:42.824334 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-5bd93163-6a3a-4abf-8263-78dd4fed7049 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:42.824780 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-5bd93163-6a3a-4abf-8263-78dd4fed7049 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:42.998870 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-65413810-ffd4-4848-ac96-2d4b4b0f3555 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:20:42.999900 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-65413810-ffd4-4848-ac96-2d4b4b0f3555 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] [instance: a3624677-f35c-4a8c-ad79-990ee6987c7b] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:20:43.006843 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-65413810-ffd4-4848-ac96-2d4b4b0f3555 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:43.007398 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-65413810-ffd4-4848-ac96-2d4b4b0f3555 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:43.008273 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-65413810-ffd4-4848-ac96-2d4b4b0f3555 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:43.008908 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-65413810-ffd4-4848-ac96-2d4b4b0f3555 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:43.013346 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-5bd93163-6a3a-4abf-8263-78dd4fed7049 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1efac6c215148ce8c3ecdce1e9a8742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d392a7d77f46fcb4faa017786796fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:20:43.022653 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-5bd93163-6a3a-4abf-8263-78dd4fed7049 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] 10.222.0.66 "GET /compute/v2.1/servers/937d4958-6710-4c44-8451-2b659b87dc63" status: 200 len: 1520 microversion: 2.1 time: 0.215014 Nov 22 12:20:43.027289 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 142/266] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:20:42 2021] GET /compute/v2.1/servers/937d4958-6710-4c44-8451-2b659b87dc63 => generated 1520 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:20:43.158222 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-65413810-ffd4-4848-ac96-2d4b4b0f3555 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc29a63c701941f9909e8235c80f5ce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc74b1d74b14a009699279eb128f9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:20:43.166512 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-65413810-ffd4-4848-ac96-2d4b4b0f3555 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] 10.222.0.66 "GET /compute/v2.1/servers/a3624677-f35c-4a8c-ad79-990ee6987c7b" status: 200 len: 1318 microversion: 2.1 time: 0.175586 Nov 22 12:20:43.167214 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 125/267] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:20:42 2021] GET /compute/v2.1/servers/a3624677-f35c-4a8c-ad79-990ee6987c7b => generated 1318 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:20:43.303795 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-3a1c2e42-8574-4665-a4fe-db457139b451 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:20:43.304402 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-3a1c2e42-8574-4665-a4fe-db457139b451 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] [instance: 8412ba15-56d4-416c-ade2-50b31de5ccb9] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:20:43.311196 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-3a1c2e42-8574-4665-a4fe-db457139b451 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:43.311709 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-3a1c2e42-8574-4665-a4fe-db457139b451 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:43.312502 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-3a1c2e42-8574-4665-a4fe-db457139b451 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:43.312915 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-3a1c2e42-8574-4665-a4fe-db457139b451 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:43.542637 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-64c834fc-e2c5-4a1f-b137-3e6a6dd3d4c3 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:20:43.544559 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-64c834fc-e2c5-4a1f-b137-3e6a6dd3d4c3 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: c9f6d441-246f-479e-8e88-ea701c0f87ff] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:20:43.552352 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-64c834fc-e2c5-4a1f-b137-3e6a6dd3d4c3 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:43.553506 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-64c834fc-e2c5-4a1f-b137-3e6a6dd3d4c3 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:43.554536 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-64c834fc-e2c5-4a1f-b137-3e6a6dd3d4c3 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:43.555345 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-64c834fc-e2c5-4a1f-b137-3e6a6dd3d4c3 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:43.646640 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-3a1c2e42-8574-4665-a4fe-db457139b451 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b581fa25045cea9585ae4e707585d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5319fd2dee9b4b47b98f59bca1572ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:20:43.656096 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-3a1c2e42-8574-4665-a4fe-db457139b451 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] 10.222.0.66 "GET /compute/v2.1/servers/8412ba15-56d4-416c-ade2-50b31de5ccb9" status: 200 len: 1317 microversion: 2.1 time: 0.355940 Nov 22 12:20:43.656677 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 143/268] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:20:43 2021] GET /compute/v2.1/servers/8412ba15-56d4-416c-ade2-50b31de5ccb9 => generated 1317 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:20:43.673607 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-61e656f3-a362-4e22-b587-448a2ffa2437 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:20:43.674212 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-61e656f3-a362-4e22-b587-448a2ffa2437 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: 2306113c-8f98-42fd-8c0c-3dfac98fff21] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:20:43.680915 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-61e656f3-a362-4e22-b587-448a2ffa2437 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:43.681361 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-61e656f3-a362-4e22-b587-448a2ffa2437 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:43.682139 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-61e656f3-a362-4e22-b587-448a2ffa2437 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:43.682568 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-61e656f3-a362-4e22-b587-448a2ffa2437 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:43.821308 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-61e656f3-a362-4e22-b587-448a2ffa2437 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41d885b9b854d8db11da5d325552301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f5dffe9bc3f41c7a2656d194fd02173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:20:43.829190 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-61e656f3-a362-4e22-b587-448a2ffa2437 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "GET /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21" status: 200 len: 1363 microversion: 2.1 time: 0.159415 Nov 22 12:20:43.829775 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 144/269] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:20:43 2021] GET /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21 => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:20:44.043106 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-c1fa8661-e2e7-4787-8c46-472134122ad6 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:20:44.043737 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-c1fa8661-e2e7-4787-8c46-472134122ad6 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] [instance: 937d4958-6710-4c44-8451-2b659b87dc63] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:20:44.050195 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-c1fa8661-e2e7-4787-8c46-472134122ad6 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:44.050637 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-c1fa8661-e2e7-4787-8c46-472134122ad6 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:44.051440 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-c1fa8661-e2e7-4787-8c46-472134122ad6 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:44.051883 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-c1fa8661-e2e7-4787-8c46-472134122ad6 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:44.203780 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-c1fa8661-e2e7-4787-8c46-472134122ad6 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1efac6c215148ce8c3ecdce1e9a8742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d392a7d77f46fcb4faa017786796fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:20:44.217290 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-c1fa8661-e2e7-4787-8c46-472134122ad6 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] 10.222.0.66 "GET /compute/v2.1/servers/937d4958-6710-4c44-8451-2b659b87dc63" status: 200 len: 1520 microversion: 2.1 time: 0.178855 Nov 22 12:20:44.219711 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 145/270] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:20:44 2021] GET /compute/v2.1/servers/937d4958-6710-4c44-8451-2b659b87dc63 => generated 1520 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 12:20:44.227791 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-024093dd-f0b2-4c22-a427-fb5a4d258851 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:20:44.228680 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-024093dd-f0b2-4c22-a427-fb5a4d258851 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] [instance: a3624677-f35c-4a8c-ad79-990ee6987c7b] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:20:44.235658 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-024093dd-f0b2-4c22-a427-fb5a4d258851 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:44.236106 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-024093dd-f0b2-4c22-a427-fb5a4d258851 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:44.236900 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-024093dd-f0b2-4c22-a427-fb5a4d258851 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:44.237328 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-024093dd-f0b2-4c22-a427-fb5a4d258851 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:44.379123 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-024093dd-f0b2-4c22-a427-fb5a4d258851 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc29a63c701941f9909e8235c80f5ce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc74b1d74b14a009699279eb128f9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:20:44.386698 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-024093dd-f0b2-4c22-a427-fb5a4d258851 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] 10.222.0.66 "GET /compute/v2.1/servers/a3624677-f35c-4a8c-ad79-990ee6987c7b" status: 200 len: 1318 microversion: 2.1 time: 0.165551 Nov 22 12:20:44.387324 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 146/271] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:20:44 2021] GET /compute/v2.1/servers/a3624677-f35c-4a8c-ad79-990ee6987c7b => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:20:44.673960 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-fd6a7708-c15b-454a-b653-f11871ed0105 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:20:44.674676 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-fd6a7708-c15b-454a-b653-f11871ed0105 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] [instance: 8412ba15-56d4-416c-ade2-50b31de5ccb9] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:20:44.681105 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-fd6a7708-c15b-454a-b653-f11871ed0105 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:44.681539 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-fd6a7708-c15b-454a-b653-f11871ed0105 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:44.682317 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-fd6a7708-c15b-454a-b653-f11871ed0105 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:44.682746 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-fd6a7708-c15b-454a-b653-f11871ed0105 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:44.838009 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-fd6a7708-c15b-454a-b653-f11871ed0105 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b581fa25045cea9585ae4e707585d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5319fd2dee9b4b47b98f59bca1572ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:20:44.850444 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-fd6a7708-c15b-454a-b653-f11871ed0105 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] 10.222.0.66 "GET /compute/v2.1/servers/8412ba15-56d4-416c-ade2-50b31de5ccb9" status: 200 len: 1317 microversion: 2.1 time: 0.179976 Nov 22 12:20:44.852016 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 147/272] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:20:44 2021] GET /compute/v2.1/servers/8412ba15-56d4-416c-ade2-50b31de5ccb9 => generated 1317 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 12:20:44.856872 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-3ff82ba7-8b8b-4550-895d-8a79c31b064d tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:20:44.857473 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-3ff82ba7-8b8b-4550-895d-8a79c31b064d tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: 2306113c-8f98-42fd-8c0c-3dfac98fff21] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:20:44.864374 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-3ff82ba7-8b8b-4550-895d-8a79c31b064d tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:44.864819 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-3ff82ba7-8b8b-4550-895d-8a79c31b064d tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:44.865634 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-3ff82ba7-8b8b-4550-895d-8a79c31b064d tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:44.866062 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-3ff82ba7-8b8b-4550-895d-8a79c31b064d tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:45.021265 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-3ff82ba7-8b8b-4550-895d-8a79c31b064d tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41d885b9b854d8db11da5d325552301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f5dffe9bc3f41c7a2656d194fd02173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:20:45.029391 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-3ff82ba7-8b8b-4550-895d-8a79c31b064d tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "GET /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21" status: 200 len: 1363 microversion: 2.1 time: 0.176125 Nov 22 12:20:45.029882 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 148/273] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:20:44 2021] GET /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21 => generated 1363 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:20:45.240008 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-e20100e1-433f-480d-b123-d57d47de6beb tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:20:45.240961 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-e20100e1-433f-480d-b123-d57d47de6beb tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] [instance: 937d4958-6710-4c44-8451-2b659b87dc63] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:20:45.252305 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-e20100e1-433f-480d-b123-d57d47de6beb tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:45.252909 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-e20100e1-433f-480d-b123-d57d47de6beb tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:45.254321 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-e20100e1-433f-480d-b123-d57d47de6beb tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:45.255088 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-e20100e1-433f-480d-b123-d57d47de6beb tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:45.442718 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-e20100e1-433f-480d-b123-d57d47de6beb tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1efac6c215148ce8c3ecdce1e9a8742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d392a7d77f46fcb4faa017786796fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:20:45.450963 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-e20100e1-433f-480d-b123-d57d47de6beb tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] 10.222.0.66 "GET /compute/v2.1/servers/937d4958-6710-4c44-8451-2b659b87dc63" status: 200 len: 1520 microversion: 2.1 time: 0.217775 Nov 22 12:20:45.451613 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 149/274] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:20:45 2021] GET /compute/v2.1/servers/937d4958-6710-4c44-8451-2b659b87dc63 => generated 1520 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:20:45.456257 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-9612d4bd-1e8f-4b68-ae42-6c899d9aa174 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:20:45.456866 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-9612d4bd-1e8f-4b68-ae42-6c899d9aa174 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] [instance: a3624677-f35c-4a8c-ad79-990ee6987c7b] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:20:45.463390 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-9612d4bd-1e8f-4b68-ae42-6c899d9aa174 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:45.463840 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-9612d4bd-1e8f-4b68-ae42-6c899d9aa174 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:45.464650 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-9612d4bd-1e8f-4b68-ae42-6c899d9aa174 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:45.465080 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-9612d4bd-1e8f-4b68-ae42-6c899d9aa174 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:45.642628 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-9612d4bd-1e8f-4b68-ae42-6c899d9aa174 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc29a63c701941f9909e8235c80f5ce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc74b1d74b14a009699279eb128f9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:20:45.651103 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-9612d4bd-1e8f-4b68-ae42-6c899d9aa174 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] 10.222.0.66 "GET /compute/v2.1/servers/a3624677-f35c-4a8c-ad79-990ee6987c7b" status: 200 len: 1318 microversion: 2.1 time: 0.198387 Nov 22 12:20:45.651724 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 150/275] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:20:45 2021] GET /compute/v2.1/servers/a3624677-f35c-4a8c-ad79-990ee6987c7b => generated 1318 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:20:45.809005 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-64c834fc-e2c5-4a1f-b137-3e6a6dd3d4c3 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "POST /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff/action" status: 200 len: 28177 microversion: 2.20 time: 2.270427 Nov 22 12:20:45.809670 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 126/276] 10.222.0.66 () {62 vars in 1318 bytes} [Mon Nov 22 12:20:43 2021] POST /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff/action => generated 28177 bytes in 2272 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 12:20:45.868552 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-d074c4de-284d-4003-9d27-e1941ed66861 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:20:45.869303 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-d074c4de-284d-4003-9d27-e1941ed66861 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] [instance: 8412ba15-56d4-416c-ade2-50b31de5ccb9] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:20:45.876241 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-d074c4de-284d-4003-9d27-e1941ed66861 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:45.876687 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-d074c4de-284d-4003-9d27-e1941ed66861 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:45.877492 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-d074c4de-284d-4003-9d27-e1941ed66861 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:45.877935 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-d074c4de-284d-4003-9d27-e1941ed66861 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:46.021692 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-d074c4de-284d-4003-9d27-e1941ed66861 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b581fa25045cea9585ae4e707585d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5319fd2dee9b4b47b98f59bca1572ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:20:46.029525 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-d074c4de-284d-4003-9d27-e1941ed66861 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] 10.222.0.66 "GET /compute/v2.1/servers/8412ba15-56d4-416c-ade2-50b31de5ccb9" status: 200 len: 1317 microversion: 2.1 time: 0.164652 Nov 22 12:20:46.030124 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 151/277] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:20:45 2021] GET /compute/v2.1/servers/8412ba15-56d4-416c-ade2-50b31de5ccb9 => generated 1317 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:20:46.048744 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-f85660d3-1238-4798-bdb5-94f68ad1854b tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:20:46.049439 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-f85660d3-1238-4798-bdb5-94f68ad1854b tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: 2306113c-8f98-42fd-8c0c-3dfac98fff21] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:20:46.056578 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-f85660d3-1238-4798-bdb5-94f68ad1854b tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:46.057028 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-f85660d3-1238-4798-bdb5-94f68ad1854b tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:46.057838 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-f85660d3-1238-4798-bdb5-94f68ad1854b tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:46.058275 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-f85660d3-1238-4798-bdb5-94f68ad1854b tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:46.231279 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-f85660d3-1238-4798-bdb5-94f68ad1854b tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41d885b9b854d8db11da5d325552301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f5dffe9bc3f41c7a2656d194fd02173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:20:46.244853 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-f85660d3-1238-4798-bdb5-94f68ad1854b tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "GET /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21" status: 200 len: 1363 microversion: 2.1 time: 0.200408 Nov 22 12:20:46.247980 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 127/278] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:20:46 2021] GET /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21 => generated 1363 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:20:46.472039 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-979a905f-5a2c-4229-aab7-50cca2b69f39 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:20:46.473109 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-979a905f-5a2c-4229-aab7-50cca2b69f39 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] [instance: 937d4958-6710-4c44-8451-2b659b87dc63] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:20:46.485055 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-979a905f-5a2c-4229-aab7-50cca2b69f39 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:46.485749 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-979a905f-5a2c-4229-aab7-50cca2b69f39 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:46.486961 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-979a905f-5a2c-4229-aab7-50cca2b69f39 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:46.487681 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-979a905f-5a2c-4229-aab7-50cca2b69f39 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:46.670807 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-1aca2a2d-8de9-4b64-9187-b588eb53976c tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:20:46.671708 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-1aca2a2d-8de9-4b64-9187-b588eb53976c tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] [instance: a3624677-f35c-4a8c-ad79-990ee6987c7b] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:20:46.682271 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-1aca2a2d-8de9-4b64-9187-b588eb53976c tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:46.683214 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-1aca2a2d-8de9-4b64-9187-b588eb53976c tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:46.683594 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-1aca2a2d-8de9-4b64-9187-b588eb53976c tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:46.684033 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-1aca2a2d-8de9-4b64-9187-b588eb53976c tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:46.709486 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-979a905f-5a2c-4229-aab7-50cca2b69f39 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1efac6c215148ce8c3ecdce1e9a8742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d392a7d77f46fcb4faa017786796fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:20:46.728433 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-979a905f-5a2c-4229-aab7-50cca2b69f39 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] 10.222.0.66 "GET /compute/v2.1/servers/937d4958-6710-4c44-8451-2b659b87dc63" status: 200 len: 1520 microversion: 2.1 time: 0.262515 Nov 22 12:20:46.731282 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 152/279] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:20:46 2021] GET /compute/v2.1/servers/937d4958-6710-4c44-8451-2b659b87dc63 => generated 1520 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:20:46.836818 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-0aa26a95-cae3-4c5e-8101-ff4f7127c51e tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:20:46.845201 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-0aa26a95-cae3-4c5e-8101-ff4f7127c51e tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: c9f6d441-246f-479e-8e88-ea701c0f87ff] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:20:46.864429 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-0aa26a95-cae3-4c5e-8101-ff4f7127c51e tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:46.866285 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-0aa26a95-cae3-4c5e-8101-ff4f7127c51e tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:46.869510 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-0aa26a95-cae3-4c5e-8101-ff4f7127c51e tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:46.872179 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-0aa26a95-cae3-4c5e-8101-ff4f7127c51e tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:47.006237 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-1aca2a2d-8de9-4b64-9187-b588eb53976c tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc29a63c701941f9909e8235c80f5ce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc74b1d74b14a009699279eb128f9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:20:47.024627 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-1aca2a2d-8de9-4b64-9187-b588eb53976c tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] 10.222.0.66 "GET /compute/v2.1/servers/a3624677-f35c-4a8c-ad79-990ee6987c7b" status: 200 len: 1318 microversion: 2.1 time: 0.358026 Nov 22 12:20:47.025673 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 128/280] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:20:46 2021] GET /compute/v2.1/servers/a3624677-f35c-4a8c-ad79-990ee6987c7b => generated 1318 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:20:47.052123 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-187db624-3e04-497c-8ee8-e89ca6e953d1 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:20:47.053279 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-187db624-3e04-497c-8ee8-e89ca6e953d1 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] [instance: 8412ba15-56d4-416c-ade2-50b31de5ccb9] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:20:47.065651 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-187db624-3e04-497c-8ee8-e89ca6e953d1 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:47.066409 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-187db624-3e04-497c-8ee8-e89ca6e953d1 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:47.067749 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-187db624-3e04-497c-8ee8-e89ca6e953d1 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:47.068491 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-187db624-3e04-497c-8ee8-e89ca6e953d1 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:47.157440 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-0aa26a95-cae3-4c5e-8101-ff4f7127c51e tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "POST /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff/action" status: 200 len: 28304 microversion: 2.20 time: 0.339021 Nov 22 12:20:47.159816 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 153/281] 10.222.0.66 () {62 vars in 1318 bytes} [Mon Nov 22 12:20:46 2021] POST /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff/action => generated 28304 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 22 12:20:47.272927 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-d1cc3baf-7b3f-45b6-aae4-d8c16545626a tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:20:47.273617 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-d1cc3baf-7b3f-45b6-aae4-d8c16545626a tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: 2306113c-8f98-42fd-8c0c-3dfac98fff21] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:20:47.283374 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-d1cc3baf-7b3f-45b6-aae4-d8c16545626a tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:47.285292 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-d1cc3baf-7b3f-45b6-aae4-d8c16545626a tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:47.286855 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-d1cc3baf-7b3f-45b6-aae4-d8c16545626a tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:47.287864 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-d1cc3baf-7b3f-45b6-aae4-d8c16545626a tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:47.315867 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-187db624-3e04-497c-8ee8-e89ca6e953d1 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b581fa25045cea9585ae4e707585d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5319fd2dee9b4b47b98f59bca1572ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:20:47.329183 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-187db624-3e04-497c-8ee8-e89ca6e953d1 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] 10.222.0.66 "GET /compute/v2.1/servers/8412ba15-56d4-416c-ade2-50b31de5ccb9" status: 200 len: 1317 microversion: 2.1 time: 0.283812 Nov 22 12:20:47.331145 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 129/282] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:20:47 2021] GET /compute/v2.1/servers/8412ba15-56d4-416c-ade2-50b31de5ccb9 => generated 1317 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:20:47.492832 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-d1cc3baf-7b3f-45b6-aae4-d8c16545626a tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41d885b9b854d8db11da5d325552301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f5dffe9bc3f41c7a2656d194fd02173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:20:47.505212 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-d1cc3baf-7b3f-45b6-aae4-d8c16545626a tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "GET /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21" status: 200 len: 1363 microversion: 2.1 time: 0.238081 Nov 22 12:20:47.506108 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 154/283] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:20:47 2021] GET /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21 => generated 1363 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 12:20:47.749116 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-c3e3ea53-6478-4a35-90c9-f0163d8644d6 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:20:47.749774 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-c3e3ea53-6478-4a35-90c9-f0163d8644d6 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] [instance: 937d4958-6710-4c44-8451-2b659b87dc63] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:20:47.757091 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-c3e3ea53-6478-4a35-90c9-f0163d8644d6 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:47.757532 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-c3e3ea53-6478-4a35-90c9-f0163d8644d6 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:47.758327 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-c3e3ea53-6478-4a35-90c9-f0163d8644d6 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:47.758759 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-c3e3ea53-6478-4a35-90c9-f0163d8644d6 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:47.933337 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-c3e3ea53-6478-4a35-90c9-f0163d8644d6 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1efac6c215148ce8c3ecdce1e9a8742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d392a7d77f46fcb4faa017786796fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:20:47.942142 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-c3e3ea53-6478-4a35-90c9-f0163d8644d6 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] 10.222.0.66 "GET /compute/v2.1/servers/937d4958-6710-4c44-8451-2b659b87dc63" status: 200 len: 1520 microversion: 2.1 time: 0.197440 Nov 22 12:20:47.942990 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 130/284] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:20:47 2021] GET /compute/v2.1/servers/937d4958-6710-4c44-8451-2b659b87dc63 => generated 1520 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:20:48.044138 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-10788ffc-a5d3-418b-8a0a-2533b37954f1 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:20:48.044960 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-10788ffc-a5d3-418b-8a0a-2533b37954f1 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] [instance: a3624677-f35c-4a8c-ad79-990ee6987c7b] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:20:48.052280 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-10788ffc-a5d3-418b-8a0a-2533b37954f1 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:48.053053 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-10788ffc-a5d3-418b-8a0a-2533b37954f1 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:48.053879 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-10788ffc-a5d3-418b-8a0a-2533b37954f1 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:48.054302 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-10788ffc-a5d3-418b-8a0a-2533b37954f1 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:48.176286 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-83a2162c-3a97-4bb4-95de-5171b1cfffa7 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:20:48.177485 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-83a2162c-3a97-4bb4-95de-5171b1cfffa7 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: c9f6d441-246f-479e-8e88-ea701c0f87ff] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:20:48.186393 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-83a2162c-3a97-4bb4-95de-5171b1cfffa7 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:48.186845 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-83a2162c-3a97-4bb4-95de-5171b1cfffa7 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:48.187865 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-83a2162c-3a97-4bb4-95de-5171b1cfffa7 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:48.189843 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-83a2162c-3a97-4bb4-95de-5171b1cfffa7 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:48.211551 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-10788ffc-a5d3-418b-8a0a-2533b37954f1 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc29a63c701941f9909e8235c80f5ce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc74b1d74b14a009699279eb128f9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:20:48.219609 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-10788ffc-a5d3-418b-8a0a-2533b37954f1 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] 10.222.0.66 "GET /compute/v2.1/servers/a3624677-f35c-4a8c-ad79-990ee6987c7b" status: 200 len: 1318 microversion: 2.1 time: 0.178990 Nov 22 12:20:48.220431 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 155/285] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:20:48 2021] GET /compute/v2.1/servers/a3624677-f35c-4a8c-ad79-990ee6987c7b => generated 1318 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 12:20:48.349506 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-e6e78b2a-30b2-494e-a884-8444b7bcf8b3 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:20:48.350202 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-e6e78b2a-30b2-494e-a884-8444b7bcf8b3 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] [instance: 8412ba15-56d4-416c-ade2-50b31de5ccb9] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:20:48.359206 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-e6e78b2a-30b2-494e-a884-8444b7bcf8b3 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:48.359931 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-e6e78b2a-30b2-494e-a884-8444b7bcf8b3 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:48.361005 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-e6e78b2a-30b2-494e-a884-8444b7bcf8b3 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:48.361585 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-e6e78b2a-30b2-494e-a884-8444b7bcf8b3 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:48.599050 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-e6e78b2a-30b2-494e-a884-8444b7bcf8b3 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b581fa25045cea9585ae4e707585d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5319fd2dee9b4b47b98f59bca1572ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:20:48.610355 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-e6e78b2a-30b2-494e-a884-8444b7bcf8b3 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] 10.222.0.66 "GET /compute/v2.1/servers/8412ba15-56d4-416c-ade2-50b31de5ccb9" status: 200 len: 1317 microversion: 2.1 time: 0.265160 Nov 22 12:20:48.615430 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 156/286] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:20:48 2021] GET /compute/v2.1/servers/8412ba15-56d4-416c-ade2-50b31de5ccb9 => generated 1317 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:20:48.622919 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-21eb8ab7-cf77-4bbd-9381-23f09e2ec6e8 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:20:48.623487 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-21eb8ab7-cf77-4bbd-9381-23f09e2ec6e8 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: 2306113c-8f98-42fd-8c0c-3dfac98fff21] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:20:48.630381 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-21eb8ab7-cf77-4bbd-9381-23f09e2ec6e8 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:48.630820 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-21eb8ab7-cf77-4bbd-9381-23f09e2ec6e8 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:48.632007 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-21eb8ab7-cf77-4bbd-9381-23f09e2ec6e8 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:48.632443 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-21eb8ab7-cf77-4bbd-9381-23f09e2ec6e8 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:48.828325 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-21eb8ab7-cf77-4bbd-9381-23f09e2ec6e8 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41d885b9b854d8db11da5d325552301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f5dffe9bc3f41c7a2656d194fd02173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:20:48.836706 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-21eb8ab7-cf77-4bbd-9381-23f09e2ec6e8 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "GET /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21" status: 200 len: 1363 microversion: 2.1 time: 0.218824 Nov 22 12:20:48.837353 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 157/287] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:20:48 2021] GET /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21 => generated 1363 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:20:48.842476 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [req-cf810355-2bed-4da3-a2b0-b8697c7a402c req-e4ef80c7-ca3f-4b58-868d-90f081151fdd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8412ba15-56d4-416c-ade2-50b31de5ccb9", "name": "network-vif-plugged", "status": "completed", "tag": "0b5d6d5e-e442-4681-83aa-fb04b4fc7ce4"}]} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:20:48.844735 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 12:20:48.844735 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: warnings.warn(msg) Nov 22 12:20:48.852355 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [req-cf810355-2bed-4da3-a2b0-b8697c7a402c req-e4ef80c7-ca3f-4b58-868d-90f081151fdd service nova] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:48.853446 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [req-cf810355-2bed-4da3-a2b0-b8697c7a402c req-e4ef80c7-ca3f-4b58-868d-90f081151fdd service nova] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:48.868920 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.compute.server_external_events [req-cf810355-2bed-4da3-a2b0-b8697c7a402c req-e4ef80c7-ca3f-4b58-868d-90f081151fdd service nova] Creating event network-vif-plugged:0b5d6d5e-e442-4681-83aa-fb04b4fc7ce4 for instance 8412ba15-56d4-416c-ade2-50b31de5ccb9 on hv-cinder-76845 Nov 22 12:20:48.874855 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [req-cf810355-2bed-4da3-a2b0-b8697c7a402c req-e4ef80c7-ca3f-4b58-868d-90f081151fdd service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035805 Nov 22 12:20:48.875902 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 158/288] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Nov 22 12:20:48 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 12:20:48.964657 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-9219801c-83b1-4a96-b004-2ebecdc0e821 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:20:48.967048 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-9219801c-83b1-4a96-b004-2ebecdc0e821 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] [instance: 937d4958-6710-4c44-8451-2b659b87dc63] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:20:48.979090 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-9219801c-83b1-4a96-b004-2ebecdc0e821 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:48.980110 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-9219801c-83b1-4a96-b004-2ebecdc0e821 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:48.981651 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-9219801c-83b1-4a96-b004-2ebecdc0e821 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:48.982795 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-9219801c-83b1-4a96-b004-2ebecdc0e821 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:49.157265 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-9219801c-83b1-4a96-b004-2ebecdc0e821 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1efac6c215148ce8c3ecdce1e9a8742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d392a7d77f46fcb4faa017786796fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:20:49.165802 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-9219801c-83b1-4a96-b004-2ebecdc0e821 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] 10.222.0.66 "GET /compute/v2.1/servers/937d4958-6710-4c44-8451-2b659b87dc63" status: 200 len: 1520 microversion: 2.1 time: 0.208394 Nov 22 12:20:49.166389 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 159/289] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:20:48 2021] GET /compute/v2.1/servers/937d4958-6710-4c44-8451-2b659b87dc63 => generated 1520 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 12:20:49.236796 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-9d96fe3a-87cd-4d1e-8ab4-3ed87387c995 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:20:49.237672 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-9d96fe3a-87cd-4d1e-8ab4-3ed87387c995 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] [instance: a3624677-f35c-4a8c-ad79-990ee6987c7b] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:20:49.243782 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-9d96fe3a-87cd-4d1e-8ab4-3ed87387c995 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:49.244230 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-9d96fe3a-87cd-4d1e-8ab4-3ed87387c995 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:49.245200 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-9d96fe3a-87cd-4d1e-8ab4-3ed87387c995 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:49.245648 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-9d96fe3a-87cd-4d1e-8ab4-3ed87387c995 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:49.434015 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-9d96fe3a-87cd-4d1e-8ab4-3ed87387c995 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc29a63c701941f9909e8235c80f5ce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc74b1d74b14a009699279eb128f9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:20:49.442227 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-9d96fe3a-87cd-4d1e-8ab4-3ed87387c995 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] 10.222.0.66 "GET /compute/v2.1/servers/a3624677-f35c-4a8c-ad79-990ee6987c7b" status: 200 len: 1318 microversion: 2.1 time: 0.209247 Nov 22 12:20:49.442837 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 160/290] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:20:49 2021] GET /compute/v2.1/servers/a3624677-f35c-4a8c-ad79-990ee6987c7b => generated 1318 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 12:20:49.629084 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-b49449a2-5afe-4497-86f0-5161db06e787 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:20:49.629989 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-b49449a2-5afe-4497-86f0-5161db06e787 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] [instance: 8412ba15-56d4-416c-ade2-50b31de5ccb9] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:20:49.638067 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-b49449a2-5afe-4497-86f0-5161db06e787 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:49.638506 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-b49449a2-5afe-4497-86f0-5161db06e787 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:49.639328 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-b49449a2-5afe-4497-86f0-5161db06e787 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:49.639773 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-b49449a2-5afe-4497-86f0-5161db06e787 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:49.787686 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-b49449a2-5afe-4497-86f0-5161db06e787 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b581fa25045cea9585ae4e707585d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5319fd2dee9b4b47b98f59bca1572ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:20:49.795549 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-b49449a2-5afe-4497-86f0-5161db06e787 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] 10.222.0.66 "GET /compute/v2.1/servers/8412ba15-56d4-416c-ade2-50b31de5ccb9" status: 200 len: 1317 microversion: 2.1 time: 0.171208 Nov 22 12:20:49.796139 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 161/291] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:20:49 2021] GET /compute/v2.1/servers/8412ba15-56d4-416c-ade2-50b31de5ccb9 => generated 1317 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 12:20:49.865238 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-30e25913-21ab-48b5-803c-edddc8b5ffb6 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:20:49.865851 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-30e25913-21ab-48b5-803c-edddc8b5ffb6 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: 2306113c-8f98-42fd-8c0c-3dfac98fff21] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:20:49.873045 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-30e25913-21ab-48b5-803c-edddc8b5ffb6 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:49.873496 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-30e25913-21ab-48b5-803c-edddc8b5ffb6 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:49.874274 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-30e25913-21ab-48b5-803c-edddc8b5ffb6 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:49.874871 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-30e25913-21ab-48b5-803c-edddc8b5ffb6 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:50.023428 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-30e25913-21ab-48b5-803c-edddc8b5ffb6 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41d885b9b854d8db11da5d325552301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f5dffe9bc3f41c7a2656d194fd02173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:20:50.033087 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-30e25913-21ab-48b5-803c-edddc8b5ffb6 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "GET /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21" status: 200 len: 1363 microversion: 2.1 time: 0.171482 Nov 22 12:20:50.033676 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 162/292] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:20:49 2021] GET /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21 => generated 1363 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:20:50.182333 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-754023d3-c96f-40d3-9502-c394b86e79d4 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:20:50.183068 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-754023d3-c96f-40d3-9502-c394b86e79d4 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] [instance: 937d4958-6710-4c44-8451-2b659b87dc63] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:20:50.189515 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-754023d3-c96f-40d3-9502-c394b86e79d4 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:50.189940 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-754023d3-c96f-40d3-9502-c394b86e79d4 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:50.190737 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-754023d3-c96f-40d3-9502-c394b86e79d4 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:50.191163 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-754023d3-c96f-40d3-9502-c394b86e79d4 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:50.329207 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-83a2162c-3a97-4bb4-95de-5171b1cfffa7 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "POST /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff/action" status: 200 len: 28468 microversion: 2.20 time: 2.158916 Nov 22 12:20:50.329863 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 131/293] 10.222.0.66 () {62 vars in 1318 bytes} [Mon Nov 22 12:20:48 2021] POST /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff/action => generated 28468 bytes in 2162 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 12:20:50.341036 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-754023d3-c96f-40d3-9502-c394b86e79d4 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1efac6c215148ce8c3ecdce1e9a8742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d392a7d77f46fcb4faa017786796fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:20:50.349976 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-754023d3-c96f-40d3-9502-c394b86e79d4 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] 10.222.0.66 "GET /compute/v2.1/servers/937d4958-6710-4c44-8451-2b659b87dc63" status: 200 len: 1520 microversion: 2.1 time: 0.171148 Nov 22 12:20:50.350551 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 163/294] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:20:50 2021] GET /compute/v2.1/servers/937d4958-6710-4c44-8451-2b659b87dc63 => generated 1520 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:20:50.459486 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-4c607ada-093e-4abe-9b65-7f0c3505ffb7 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:20:50.460239 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-4c607ada-093e-4abe-9b65-7f0c3505ffb7 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] [instance: a3624677-f35c-4a8c-ad79-990ee6987c7b] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:20:50.469679 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-4c607ada-093e-4abe-9b65-7f0c3505ffb7 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:50.470057 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-4c607ada-093e-4abe-9b65-7f0c3505ffb7 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:50.470810 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-4c607ada-093e-4abe-9b65-7f0c3505ffb7 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:50.471271 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-4c607ada-093e-4abe-9b65-7f0c3505ffb7 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:50.616734 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-4c607ada-093e-4abe-9b65-7f0c3505ffb7 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc29a63c701941f9909e8235c80f5ce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc74b1d74b14a009699279eb128f9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:20:50.624681 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-4c607ada-093e-4abe-9b65-7f0c3505ffb7 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] 10.222.0.66 "GET /compute/v2.1/servers/a3624677-f35c-4a8c-ad79-990ee6987c7b" status: 200 len: 1318 microversion: 2.1 time: 0.169212 Nov 22 12:20:50.625863 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 132/295] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:20:50 2021] GET /compute/v2.1/servers/a3624677-f35c-4a8c-ad79-990ee6987c7b => generated 1318 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 12:20:50.813307 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-dddbb735-6a6e-4896-a303-17038a0e4cee tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:20:50.814269 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-dddbb735-6a6e-4896-a303-17038a0e4cee tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] [instance: 8412ba15-56d4-416c-ade2-50b31de5ccb9] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:20:50.820789 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-dddbb735-6a6e-4896-a303-17038a0e4cee tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:50.821259 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-dddbb735-6a6e-4896-a303-17038a0e4cee tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:50.822038 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-dddbb735-6a6e-4896-a303-17038a0e4cee tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:50.822645 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-dddbb735-6a6e-4896-a303-17038a0e4cee tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:50.901879 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [req-f0fc7a49-d921-4064-97ee-f2ac730ca121 req-53f5ac3c-6462-4da7-8514-12e0fd28967b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2306113c-8f98-42fd-8c0c-3dfac98fff21", "name": "network-vif-plugged", "status": "completed", "tag": "0b19f5ef-ff09-43ae-866e-7b3d6c9fc45c"}, {"server_uuid": "a3624677-f35c-4a8c-ad79-990ee6987c7b", "name": "network-vif-plugged", "status": "completed", "tag": "2dd5ed5d-5998-4e11-8d38-8460b3dd3760"}]} {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:20:50.905331 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 12:20:50.905331 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: warnings.warn(msg) Nov 22 12:20:50.916858 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [req-f0fc7a49-d921-4064-97ee-f2ac730ca121 req-53f5ac3c-6462-4da7-8514-12e0fd28967b service nova] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:50.917292 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [req-f0fc7a49-d921-4064-97ee-f2ac730ca121 req-53f5ac3c-6462-4da7-8514-12e0fd28967b service nova] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:50.939533 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.compute.server_external_events [req-f0fc7a49-d921-4064-97ee-f2ac730ca121 req-53f5ac3c-6462-4da7-8514-12e0fd28967b service nova] Creating event network-vif-plugged:0b19f5ef-ff09-43ae-866e-7b3d6c9fc45c for instance 2306113c-8f98-42fd-8c0c-3dfac98fff21 on hv-cinder-76845 Nov 22 12:20:50.940487 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.compute.server_external_events [req-f0fc7a49-d921-4064-97ee-f2ac730ca121 req-53f5ac3c-6462-4da7-8514-12e0fd28967b service nova] Creating event network-vif-plugged:2dd5ed5d-5998-4e11-8d38-8460b3dd3760 for instance a3624677-f35c-4a8c-ad79-990ee6987c7b on hv-cinder-76845 Nov 22 12:20:50.952190 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [req-f0fc7a49-d921-4064-97ee-f2ac730ca121 req-53f5ac3c-6462-4da7-8514-12e0fd28967b service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.056063 Nov 22 12:20:50.953733 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 133/296] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Nov 22 12:20:50 2021] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 22 12:20:50.999908 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-dddbb735-6a6e-4896-a303-17038a0e4cee tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b581fa25045cea9585ae4e707585d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5319fd2dee9b4b47b98f59bca1572ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:20:51.011361 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-dddbb735-6a6e-4896-a303-17038a0e4cee tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] 10.222.0.66 "GET /compute/v2.1/servers/8412ba15-56d4-416c-ade2-50b31de5ccb9" status: 200 len: 1317 microversion: 2.1 time: 0.201811 Nov 22 12:20:51.012045 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 164/297] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:20:50 2021] GET /compute/v2.1/servers/8412ba15-56d4-416c-ade2-50b31de5ccb9 => generated 1317 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:20:51.052201 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-38599fac-669e-4c4a-91b6-0114d11f47d9 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:20:51.053309 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-38599fac-669e-4c4a-91b6-0114d11f47d9 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: 2306113c-8f98-42fd-8c0c-3dfac98fff21] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:20:51.061506 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-38599fac-669e-4c4a-91b6-0114d11f47d9 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:51.062687 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-38599fac-669e-4c4a-91b6-0114d11f47d9 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:51.063704 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-38599fac-669e-4c4a-91b6-0114d11f47d9 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:51.064134 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-38599fac-669e-4c4a-91b6-0114d11f47d9 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:51.218855 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-38599fac-669e-4c4a-91b6-0114d11f47d9 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41d885b9b854d8db11da5d325552301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f5dffe9bc3f41c7a2656d194fd02173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:20:51.226728 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-38599fac-669e-4c4a-91b6-0114d11f47d9 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "GET /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21" status: 200 len: 1363 microversion: 2.1 time: 0.179293 Nov 22 12:20:51.228028 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 134/298] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:20:51 2021] GET /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21 => generated 1363 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:20:51.341980 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-1c7b2728-04da-47b0-8775-eafa33346d1b tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:20:51.344432 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-1c7b2728-04da-47b0-8775-eafa33346d1b tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: c9f6d441-246f-479e-8e88-ea701c0f87ff] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:20:51.351973 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-1c7b2728-04da-47b0-8775-eafa33346d1b tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:51.352900 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-1c7b2728-04da-47b0-8775-eafa33346d1b tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:51.353878 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-1c7b2728-04da-47b0-8775-eafa33346d1b tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:51.354698 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-1c7b2728-04da-47b0-8775-eafa33346d1b tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:51.367570 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-4a8cc63f-8ba7-4e56-a7f0-112866f27906 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:20:51.369069 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-4a8cc63f-8ba7-4e56-a7f0-112866f27906 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] [instance: 937d4958-6710-4c44-8451-2b659b87dc63] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:20:51.383572 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-4a8cc63f-8ba7-4e56-a7f0-112866f27906 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:51.384132 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-4a8cc63f-8ba7-4e56-a7f0-112866f27906 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:51.384994 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-4a8cc63f-8ba7-4e56-a7f0-112866f27906 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:51.385618 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-4a8cc63f-8ba7-4e56-a7f0-112866f27906 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:51.455854 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-1c7b2728-04da-47b0-8775-eafa33346d1b tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "POST /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff/action" status: 200 len: 28468 microversion: 2.20 time: 0.117262 Nov 22 12:20:51.462588 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 165/299] 10.222.0.66 () {62 vars in 1318 bytes} [Mon Nov 22 12:20:51 2021] POST /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff/action => generated 28468 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 12:20:51.575812 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-4a8cc63f-8ba7-4e56-a7f0-112866f27906 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1efac6c215148ce8c3ecdce1e9a8742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d392a7d77f46fcb4faa017786796fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:20:51.584839 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-4a8cc63f-8ba7-4e56-a7f0-112866f27906 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] 10.222.0.66 "GET /compute/v2.1/servers/937d4958-6710-4c44-8451-2b659b87dc63" status: 200 len: 1500 microversion: 2.1 time: 0.221598 Nov 22 12:20:51.585571 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 135/300] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:20:51 2021] GET /compute/v2.1/servers/937d4958-6710-4c44-8451-2b659b87dc63 => generated 1500 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 12:20:51.602837 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-01aa686d-00fa-4a63-842e-68418f63e3da tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:20:51.603775 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-01aa686d-00fa-4a63-842e-68418f63e3da tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] [instance: 302ab8ef-5565-4f9b-9b91-b405d550a90d] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:20:51.611570 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-01aa686d-00fa-4a63-842e-68418f63e3da tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:51.612237 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-01aa686d-00fa-4a63-842e-68418f63e3da tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:51.613019 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-01aa686d-00fa-4a63-842e-68418f63e3da tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:51.613608 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-01aa686d-00fa-4a63-842e-68418f63e3da tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:51.644752 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-8291bf8a-fadb-428e-a577-ecac6d8e7c39 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:20:51.646037 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-8291bf8a-fadb-428e-a577-ecac6d8e7c39 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] [instance: a3624677-f35c-4a8c-ad79-990ee6987c7b] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:20:51.654691 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-8291bf8a-fadb-428e-a577-ecac6d8e7c39 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:51.655779 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-8291bf8a-fadb-428e-a577-ecac6d8e7c39 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:51.657128 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-8291bf8a-fadb-428e-a577-ecac6d8e7c39 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:51.657948 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-8291bf8a-fadb-428e-a577-ecac6d8e7c39 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:51.797275 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-01aa686d-00fa-4a63-842e-68418f63e3da tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1efac6c215148ce8c3ecdce1e9a8742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d392a7d77f46fcb4faa017786796fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:20:51.813794 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-01aa686d-00fa-4a63-842e-68418f63e3da tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] 10.222.0.66 "GET /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d" status: 200 len: 1515 microversion: 2.1 time: 0.215022 Nov 22 12:20:51.815110 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 166/301] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:20:51 2021] GET /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d => generated 1515 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:20:51.860909 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-8291bf8a-fadb-428e-a577-ecac6d8e7c39 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc29a63c701941f9909e8235c80f5ce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc74b1d74b14a009699279eb128f9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:20:51.870698 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-8291bf8a-fadb-428e-a577-ecac6d8e7c39 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] 10.222.0.66 "GET /compute/v2.1/servers/a3624677-f35c-4a8c-ad79-990ee6987c7b" status: 200 len: 1318 microversion: 2.1 time: 0.232344 Nov 22 12:20:51.871715 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 136/302] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:20:51 2021] GET /compute/v2.1/servers/a3624677-f35c-4a8c-ad79-990ee6987c7b => generated 1318 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 12:20:52.034331 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-433feebe-15a4-4cab-a03e-1f7818c02124 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:20:52.034331 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-433feebe-15a4-4cab-a03e-1f7818c02124 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] [instance: 8412ba15-56d4-416c-ade2-50b31de5ccb9] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:20:52.038889 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-433feebe-15a4-4cab-a03e-1f7818c02124 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:52.039832 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-433feebe-15a4-4cab-a03e-1f7818c02124 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:52.040747 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-433feebe-15a4-4cab-a03e-1f7818c02124 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:52.041344 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-433feebe-15a4-4cab-a03e-1f7818c02124 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:52.204495 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-433feebe-15a4-4cab-a03e-1f7818c02124 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b581fa25045cea9585ae4e707585d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5319fd2dee9b4b47b98f59bca1572ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:20:52.213503 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-433feebe-15a4-4cab-a03e-1f7818c02124 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] 10.222.0.66 "GET /compute/v2.1/servers/8412ba15-56d4-416c-ade2-50b31de5ccb9" status: 200 len: 1317 microversion: 2.1 time: 0.187153 Nov 22 12:20:52.214076 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 167/303] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:20:52 2021] GET /compute/v2.1/servers/8412ba15-56d4-416c-ade2-50b31de5ccb9 => generated 1317 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:20:52.246514 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-974662c3-aef1-4540-b853-43ef28dc3f03 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:20:52.247663 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-974662c3-aef1-4540-b853-43ef28dc3f03 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: 2306113c-8f98-42fd-8c0c-3dfac98fff21] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:20:52.256534 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-974662c3-aef1-4540-b853-43ef28dc3f03 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:52.257085 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-974662c3-aef1-4540-b853-43ef28dc3f03 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:52.258067 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-974662c3-aef1-4540-b853-43ef28dc3f03 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:52.259005 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-974662c3-aef1-4540-b853-43ef28dc3f03 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:52.404954 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-974662c3-aef1-4540-b853-43ef28dc3f03 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41d885b9b854d8db11da5d325552301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f5dffe9bc3f41c7a2656d194fd02173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:20:52.416975 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-974662c3-aef1-4540-b853-43ef28dc3f03 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "GET /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21" status: 200 len: 1363 microversion: 2.1 time: 0.175486 Nov 22 12:20:52.418227 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 137/304] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:20:52 2021] GET /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21 => generated 1363 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:20:52.470228 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-8f7f89ea-e83f-48a4-8a83-4620189b04b8 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:20:52.471899 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-8f7f89ea-e83f-48a4-8a83-4620189b04b8 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: c9f6d441-246f-479e-8e88-ea701c0f87ff] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:20:52.479895 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-8f7f89ea-e83f-48a4-8a83-4620189b04b8 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:52.480465 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-8f7f89ea-e83f-48a4-8a83-4620189b04b8 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:52.481731 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-8f7f89ea-e83f-48a4-8a83-4620189b04b8 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:52.483204 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-8f7f89ea-e83f-48a4-8a83-4620189b04b8 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:52.617444 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-8f7f89ea-e83f-48a4-8a83-4620189b04b8 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "POST /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff/action" status: 200 len: 28536 microversion: 2.20 time: 0.152211 Nov 22 12:20:52.621595 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 168/305] 10.222.0.66 () {62 vars in 1318 bytes} [Mon Nov 22 12:20:52 2021] POST /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff/action => generated 28536 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 12:20:52.891548 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-929e62c6-f648-49a6-beb4-6ee7137461a9 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:20:52.892382 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-929e62c6-f648-49a6-beb4-6ee7137461a9 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] [instance: a3624677-f35c-4a8c-ad79-990ee6987c7b] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:20:52.901648 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-929e62c6-f648-49a6-beb4-6ee7137461a9 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:52.902317 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-929e62c6-f648-49a6-beb4-6ee7137461a9 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:52.903498 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-929e62c6-f648-49a6-beb4-6ee7137461a9 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:52.904161 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-929e62c6-f648-49a6-beb4-6ee7137461a9 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:53.076280 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-929e62c6-f648-49a6-beb4-6ee7137461a9 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc29a63c701941f9909e8235c80f5ce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc74b1d74b14a009699279eb128f9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:20:53.084454 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-929e62c6-f648-49a6-beb4-6ee7137461a9 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] 10.222.0.66 "GET /compute/v2.1/servers/a3624677-f35c-4a8c-ad79-990ee6987c7b" status: 200 len: 1318 microversion: 2.1 time: 0.198579 Nov 22 12:20:53.085036 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 138/306] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:20:52 2021] GET /compute/v2.1/servers/a3624677-f35c-4a8c-ad79-990ee6987c7b => generated 1318 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:20:53.230509 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-0674da3a-2c0d-4864-a143-44bf6bc89ab1 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:20:53.231205 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-0674da3a-2c0d-4864-a143-44bf6bc89ab1 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] [instance: 8412ba15-56d4-416c-ade2-50b31de5ccb9] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:20:53.238226 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-2ba83af3-0266-4147-8bb4-50598c66d264 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:20:53.238911 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-0674da3a-2c0d-4864-a143-44bf6bc89ab1 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:53.239356 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-2ba83af3-0266-4147-8bb4-50598c66d264 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] [instance: 302ab8ef-5565-4f9b-9b91-b405d550a90d] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:20:53.239479 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-0674da3a-2c0d-4864-a143-44bf6bc89ab1 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:53.240267 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-0674da3a-2c0d-4864-a143-44bf6bc89ab1 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:53.240675 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-0674da3a-2c0d-4864-a143-44bf6bc89ab1 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:53.245499 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-2ba83af3-0266-4147-8bb4-50598c66d264 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:53.245969 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-2ba83af3-0266-4147-8bb4-50598c66d264 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:53.246970 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-2ba83af3-0266-4147-8bb4-50598c66d264 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:53.247436 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-2ba83af3-0266-4147-8bb4-50598c66d264 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:53.270826 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.objects.instance [None req-2ba83af3-0266-4147-8bb4-50598c66d264 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lazy-loading 'flavor' on Instance uuid 302ab8ef-5565-4f9b-9b91-b405d550a90d {{(pid=116273) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 22 12:20:53.393769 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-2ba83af3-0266-4147-8bb4-50598c66d264 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] 10.222.0.66 "POST /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d/action" status: 200 len: 32 microversion: 2.1 time: 0.159435 Nov 22 12:20:53.394287 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 139/307] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Nov 22 12:20:53 2021] POST /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d/action => generated 32 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 22 12:20:53.403408 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-decf302b-1824-43c2-9b2f-2b46adb81c5f tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:20:53.403725 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-0674da3a-2c0d-4864-a143-44bf6bc89ab1 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b581fa25045cea9585ae4e707585d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5319fd2dee9b4b47b98f59bca1572ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:20:53.404099 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-decf302b-1824-43c2-9b2f-2b46adb81c5f tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] [instance: 302ab8ef-5565-4f9b-9b91-b405d550a90d] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:20:53.411059 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-decf302b-1824-43c2-9b2f-2b46adb81c5f tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:53.411752 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-0674da3a-2c0d-4864-a143-44bf6bc89ab1 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] 10.222.0.66 "GET /compute/v2.1/servers/8412ba15-56d4-416c-ade2-50b31de5ccb9" status: 200 len: 1506 microversion: 2.1 time: 0.185040 Nov 22 12:20:53.411850 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-decf302b-1824-43c2-9b2f-2b46adb81c5f tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:53.412104 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 169/308] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:20:53 2021] GET /compute/v2.1/servers/8412ba15-56d4-416c-ade2-50b31de5ccb9 => generated 1506 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:20:53.412315 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-decf302b-1824-43c2-9b2f-2b46adb81c5f tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:53.412742 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-decf302b-1824-43c2-9b2f-2b46adb81c5f tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:53.428398 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-e4daff64-f0fc-44e0-ae4d-c0c46e128040 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "81c31f27-cfdf-416d-9aab-f9591b037600"}} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:20:53.429908 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-e4daff64-f0fc-44e0-ae4d-c0c46e128040 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] [instance: 8412ba15-56d4-416c-ade2-50b31de5ccb9] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:20:53.435821 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-e4daff64-f0fc-44e0-ae4d-c0c46e128040 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:53.436275 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-e4daff64-f0fc-44e0-ae4d-c0c46e128040 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:53.437068 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-e4daff64-f0fc-44e0-ae4d-c0c46e128040 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:53.437711 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-e4daff64-f0fc-44e0-ae4d-c0c46e128040 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:53.521633 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.wsgi [None req-e4daff64-f0fc-44e0-ae4d-c0c46e128040 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] HTTP exception thrown: Invalid volume: volume 81c31f27-cfdf-416d-9aab-f9591b037600 is already attached to instances: 09a121f0-f7e5-4376-96bf-7008344dfe06 Nov 22 12:20:53.522249 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-e4daff64-f0fc-44e0-ae4d-c0c46e128040 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Returning 400 to user: Invalid volume: volume 81c31f27-cfdf-416d-9aab-f9591b037600 is already attached to instances: 09a121f0-f7e5-4376-96bf-7008344dfe06 {{(pid=116272) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 12:20:53.523052 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-e4daff64-f0fc-44e0-ae4d-c0c46e128040 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] 10.222.0.66 "POST /compute/v2.1/servers/8412ba15-56d4-416c-ade2-50b31de5ccb9/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.098604 Nov 22 12:20:53.523682 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 170/309] 10.222.0.66 () {60 vars in 1322 bytes} [Mon Nov 22 12:20:53 2021] POST /compute/v2.1/servers/8412ba15-56d4-416c-ade2-50b31de5ccb9/os-volume_attachments => generated 174 bytes in 100 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Nov 22 12:20:53.528301 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-95223618-d9e5-4126-918b-8a6807cfd08c tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:20:53.528909 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-95223618-d9e5-4126-918b-8a6807cfd08c tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: 2306113c-8f98-42fd-8c0c-3dfac98fff21] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:20:53.535931 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-95223618-d9e5-4126-918b-8a6807cfd08c tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:53.536384 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-95223618-d9e5-4126-918b-8a6807cfd08c tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:53.537165 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-95223618-d9e5-4126-918b-8a6807cfd08c tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:53.537762 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-95223618-d9e5-4126-918b-8a6807cfd08c tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:53.565564 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-decf302b-1824-43c2-9b2f-2b46adb81c5f tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1efac6c215148ce8c3ecdce1e9a8742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d392a7d77f46fcb4faa017786796fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:20:53.573232 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-decf302b-1824-43c2-9b2f-2b46adb81c5f tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] 10.222.0.66 "GET /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d" status: 200 len: 1521 microversion: 2.1 time: 0.173652 Nov 22 12:20:53.574237 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 140/310] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:20:53 2021] GET /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 12:20:53.606366 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-92724644-d41d-45f1-9980-d4762e114a4c tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:20:53.606859 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-92724644-d41d-45f1-9980-d4762e114a4c tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] [instance: 09a121f0-f7e5-4376-96bf-7008344dfe06] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:20:53.613786 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-92724644-d41d-45f1-9980-d4762e114a4c tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:53.614245 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-92724644-d41d-45f1-9980-d4762e114a4c tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:53.615057 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-92724644-d41d-45f1-9980-d4762e114a4c tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:53.615491 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-92724644-d41d-45f1-9980-d4762e114a4c tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:53.692341 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-95223618-d9e5-4126-918b-8a6807cfd08c tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41d885b9b854d8db11da5d325552301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f5dffe9bc3f41c7a2656d194fd02173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:20:53.700540 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-95223618-d9e5-4126-918b-8a6807cfd08c tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "GET /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21" status: 200 len: 1363 microversion: 2.1 time: 0.175856 Nov 22 12:20:53.701429 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 171/311] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:20:53 2021] GET /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21 => generated 1363 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:20:53.716163 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-1cd45dc8-2ee2-4e83-8603-87f448e8e37a tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:20:53.717754 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-1cd45dc8-2ee2-4e83-8603-87f448e8e37a tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: c9f6d441-246f-479e-8e88-ea701c0f87ff] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:20:53.727709 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-1cd45dc8-2ee2-4e83-8603-87f448e8e37a tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:53.728185 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-1cd45dc8-2ee2-4e83-8603-87f448e8e37a tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:53.728972 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-1cd45dc8-2ee2-4e83-8603-87f448e8e37a tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:53.729407 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-1cd45dc8-2ee2-4e83-8603-87f448e8e37a tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:53.758972 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.objects.instance [None req-92724644-d41d-45f1-9980-d4762e114a4c tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lazy-loading 'services' on Instance uuid 09a121f0-f7e5-4376-96bf-7008344dfe06 {{(pid=116273) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 22 12:20:53.874535 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-92724644-d41d-45f1-9980-d4762e114a4c tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] 10.222.0.66 "DELETE /compute/v2.1/servers/09a121f0-f7e5-4376-96bf-7008344dfe06/os-volume_attachments/81c31f27-cfdf-416d-9aab-f9591b037600" status: 202 len: 0 microversion: 2.1 time: 0.272102 Nov 22 12:20:53.878652 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 141/312] 10.222.0.66 () {58 vars in 1415 bytes} [Mon Nov 22 12:20:53 2021] DELETE /compute/v2.1/servers/09a121f0-f7e5-4376-96bf-7008344dfe06/os-volume_attachments/81c31f27-cfdf-416d-9aab-f9591b037600 => generated 0 bytes in 274 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 22 12:20:53.884142 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-d515bac3-c9ce-4c48-bc52-14bedfa9232e tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:20:53.885196 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-d515bac3-c9ce-4c48-bc52-14bedfa9232e tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] [instance: 09a121f0-f7e5-4376-96bf-7008344dfe06] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:20:53.891800 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-d515bac3-c9ce-4c48-bc52-14bedfa9232e tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:53.892251 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-d515bac3-c9ce-4c48-bc52-14bedfa9232e tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:53.893031 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-d515bac3-c9ce-4c48-bc52-14bedfa9232e tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:53.893460 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-d515bac3-c9ce-4c48-bc52-14bedfa9232e tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:53.925586 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-d515bac3-c9ce-4c48-bc52-14bedfa9232e tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] 10.222.0.66 "GET /compute/v2.1/servers/09a121f0-f7e5-4376-96bf-7008344dfe06/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045399 Nov 22 12:20:53.926129 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 142/313] 10.222.0.66 () {58 vars in 1301 bytes} [Mon Nov 22 12:20:53 2021] GET /compute/v2.1/servers/09a121f0-f7e5-4376-96bf-7008344dfe06/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 22 12:20:54.102450 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-542f0298-767f-4584-b529-865fbdc5e800 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:20:54.103324 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-542f0298-767f-4584-b529-865fbdc5e800 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] [instance: a3624677-f35c-4a8c-ad79-990ee6987c7b] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:20:54.109964 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-542f0298-767f-4584-b529-865fbdc5e800 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:54.110415 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-542f0298-767f-4584-b529-865fbdc5e800 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:54.111200 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-542f0298-767f-4584-b529-865fbdc5e800 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:54.111650 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-542f0298-767f-4584-b529-865fbdc5e800 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:54.303015 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-542f0298-767f-4584-b529-865fbdc5e800 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc29a63c701941f9909e8235c80f5ce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc74b1d74b14a009699279eb128f9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:20:54.315449 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-542f0298-767f-4584-b529-865fbdc5e800 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] 10.222.0.66 "GET /compute/v2.1/servers/a3624677-f35c-4a8c-ad79-990ee6987c7b" status: 200 len: 1318 microversion: 2.1 time: 0.216918 Nov 22 12:20:54.316152 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 143/314] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:20:54 2021] GET /compute/v2.1/servers/a3624677-f35c-4a8c-ad79-990ee6987c7b => generated 1318 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:20:54.591773 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-53c25503-27ee-48aa-9561-e5a0e3bf9667 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:20:54.592451 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-53c25503-27ee-48aa-9561-e5a0e3bf9667 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] [instance: 302ab8ef-5565-4f9b-9b91-b405d550a90d] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:20:54.598816 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-53c25503-27ee-48aa-9561-e5a0e3bf9667 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:54.599298 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-53c25503-27ee-48aa-9561-e5a0e3bf9667 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:54.600172 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-53c25503-27ee-48aa-9561-e5a0e3bf9667 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:54.600603 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-53c25503-27ee-48aa-9561-e5a0e3bf9667 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:54.741622 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-53c25503-27ee-48aa-9561-e5a0e3bf9667 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1efac6c215148ce8c3ecdce1e9a8742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d392a7d77f46fcb4faa017786796fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:20:54.749765 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-53c25503-27ee-48aa-9561-e5a0e3bf9667 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] 10.222.0.66 "GET /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d" status: 200 len: 1521 microversion: 2.1 time: 0.162475 Nov 22 12:20:54.759631 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 144/315] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:20:54 2021] GET /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:20:54.759631 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-274d6e62-8297-4189-93c5-fb70a6e675c4 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:20:54.759631 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-274d6e62-8297-4189-93c5-fb70a6e675c4 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: 2306113c-8f98-42fd-8c0c-3dfac98fff21] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:20:54.762654 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-274d6e62-8297-4189-93c5-fb70a6e675c4 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:54.763169 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-274d6e62-8297-4189-93c5-fb70a6e675c4 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:54.764034 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-274d6e62-8297-4189-93c5-fb70a6e675c4 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:54.764535 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-274d6e62-8297-4189-93c5-fb70a6e675c4 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:54.910791 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-274d6e62-8297-4189-93c5-fb70a6e675c4 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41d885b9b854d8db11da5d325552301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f5dffe9bc3f41c7a2656d194fd02173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:20:54.919923 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-274d6e62-8297-4189-93c5-fb70a6e675c4 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "GET /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21" status: 200 len: 1363 microversion: 2.1 time: 0.168057 Nov 22 12:20:54.920507 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 145/316] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:20:54 2021] GET /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21 => generated 1363 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:20:54.937653 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-8cb1d60b-975b-40af-8d7e-622c403cc157 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:20:54.938792 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-8cb1d60b-975b-40af-8d7e-622c403cc157 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] [instance: 09a121f0-f7e5-4376-96bf-7008344dfe06] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:20:54.945689 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-8cb1d60b-975b-40af-8d7e-622c403cc157 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:54.946203 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-8cb1d60b-975b-40af-8d7e-622c403cc157 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:54.947070 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-8cb1d60b-975b-40af-8d7e-622c403cc157 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:54.947585 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-8cb1d60b-975b-40af-8d7e-622c403cc157 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:54.980144 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-8cb1d60b-975b-40af-8d7e-622c403cc157 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] 10.222.0.66 "GET /compute/v2.1/servers/09a121f0-f7e5-4376-96bf-7008344dfe06/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046619 Nov 22 12:20:54.980723 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 146/317] 10.222.0.66 () {58 vars in 1301 bytes} [Mon Nov 22 12:20:54 2021] GET /compute/v2.1/servers/09a121f0-f7e5-4376-96bf-7008344dfe06/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 22 12:20:55.336149 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-da21fff7-7201-4e41-87ef-2f5ae220d007 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:20:55.336619 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-da21fff7-7201-4e41-87ef-2f5ae220d007 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] [instance: a3624677-f35c-4a8c-ad79-990ee6987c7b] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:20:55.342895 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-da21fff7-7201-4e41-87ef-2f5ae220d007 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:55.343216 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-da21fff7-7201-4e41-87ef-2f5ae220d007 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:55.344064 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-da21fff7-7201-4e41-87ef-2f5ae220d007 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:55.344524 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-da21fff7-7201-4e41-87ef-2f5ae220d007 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:55.486500 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-da21fff7-7201-4e41-87ef-2f5ae220d007 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc29a63c701941f9909e8235c80f5ce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc74b1d74b14a009699279eb128f9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:20:55.494431 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-da21fff7-7201-4e41-87ef-2f5ae220d007 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] 10.222.0.66 "GET /compute/v2.1/servers/a3624677-f35c-4a8c-ad79-990ee6987c7b" status: 200 len: 1318 microversion: 2.1 time: 0.164872 Nov 22 12:20:55.495009 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 147/318] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:20:55 2021] GET /compute/v2.1/servers/a3624677-f35c-4a8c-ad79-990ee6987c7b => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:20:55.767862 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-a9cf6274-969c-457a-9e04-5ff14a50c5d8 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:20:55.768946 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-a9cf6274-969c-457a-9e04-5ff14a50c5d8 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] [instance: 302ab8ef-5565-4f9b-9b91-b405d550a90d] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:20:55.775448 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-a9cf6274-969c-457a-9e04-5ff14a50c5d8 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:55.775909 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-a9cf6274-969c-457a-9e04-5ff14a50c5d8 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:55.776699 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-a9cf6274-969c-457a-9e04-5ff14a50c5d8 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:55.777128 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-a9cf6274-969c-457a-9e04-5ff14a50c5d8 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:55.919372 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-a9cf6274-969c-457a-9e04-5ff14a50c5d8 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1efac6c215148ce8c3ecdce1e9a8742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d392a7d77f46fcb4faa017786796fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:20:55.927957 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-a9cf6274-969c-457a-9e04-5ff14a50c5d8 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] 10.222.0.66 "GET /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d" status: 200 len: 1521 microversion: 2.1 time: 0.164423 Nov 22 12:20:55.928526 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 148/319] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:20:55 2021] GET /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:20:55.942410 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-1181f43f-e3b8-4c21-8def-b362a093b1fd tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:20:55.943617 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-1181f43f-e3b8-4c21-8def-b362a093b1fd tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: 2306113c-8f98-42fd-8c0c-3dfac98fff21] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:20:55.953936 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-1181f43f-e3b8-4c21-8def-b362a093b1fd tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:55.954656 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-1181f43f-e3b8-4c21-8def-b362a093b1fd tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:55.956099 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-1181f43f-e3b8-4c21-8def-b362a093b1fd tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:55.956871 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-1181f43f-e3b8-4c21-8def-b362a093b1fd tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:56.109715 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-1181f43f-e3b8-4c21-8def-b362a093b1fd tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41d885b9b854d8db11da5d325552301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f5dffe9bc3f41c7a2656d194fd02173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:20:56.118330 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-1181f43f-e3b8-4c21-8def-b362a093b1fd tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "GET /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21" status: 200 len: 1363 microversion: 2.1 time: 0.183049 Nov 22 12:20:56.118925 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 149/320] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:20:55 2021] GET /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21 => generated 1363 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:20:56.123451 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-3cc1b013-8cfe-404c-a69a-475a28b46873 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:20:56.124432 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-3cc1b013-8cfe-404c-a69a-475a28b46873 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] [instance: 09a121f0-f7e5-4376-96bf-7008344dfe06] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:20:56.130810 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-3cc1b013-8cfe-404c-a69a-475a28b46873 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:56.131287 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-3cc1b013-8cfe-404c-a69a-475a28b46873 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:56.132122 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-3cc1b013-8cfe-404c-a69a-475a28b46873 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:56.132612 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-3cc1b013-8cfe-404c-a69a-475a28b46873 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:56.163603 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-3cc1b013-8cfe-404c-a69a-475a28b46873 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] 10.222.0.66 "GET /compute/v2.1/servers/09a121f0-f7e5-4376-96bf-7008344dfe06/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043546 Nov 22 12:20:56.164181 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 150/321] 10.222.0.66 () {58 vars in 1301 bytes} [Mon Nov 22 12:20:56 2021] GET /compute/v2.1/servers/09a121f0-f7e5-4376-96bf-7008344dfe06/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 12:20:56.174984 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-1cd45dc8-2ee2-4e83-8603-87f448e8e37a tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "POST /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff/action" status: 200 len: 28631 microversion: 2.20 time: 2.472126 Nov 22 12:20:56.175586 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 172/322] 10.222.0.66 () {62 vars in 1318 bytes} [Mon Nov 22 12:20:53 2021] POST /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff/action => generated 28631 bytes in 2474 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 12:20:56.514335 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-b191bdc8-fca9-4aa6-9168-78dd1c0b5a41 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:20:56.514929 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-b191bdc8-fca9-4aa6-9168-78dd1c0b5a41 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] [instance: a3624677-f35c-4a8c-ad79-990ee6987c7b] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:20:56.521879 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-b191bdc8-fca9-4aa6-9168-78dd1c0b5a41 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:56.522329 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-b191bdc8-fca9-4aa6-9168-78dd1c0b5a41 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:56.523166 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-b191bdc8-fca9-4aa6-9168-78dd1c0b5a41 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:56.523645 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-b191bdc8-fca9-4aa6-9168-78dd1c0b5a41 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:56.679414 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-b191bdc8-fca9-4aa6-9168-78dd1c0b5a41 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc29a63c701941f9909e8235c80f5ce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc74b1d74b14a009699279eb128f9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:20:56.687695 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-b191bdc8-fca9-4aa6-9168-78dd1c0b5a41 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] 10.222.0.66 "GET /compute/v2.1/servers/a3624677-f35c-4a8c-ad79-990ee6987c7b" status: 200 len: 1506 microversion: 2.1 time: 0.178792 Nov 22 12:20:56.688485 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 151/323] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:20:56 2021] GET /compute/v2.1/servers/a3624677-f35c-4a8c-ad79-990ee6987c7b => generated 1506 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:20:56.946808 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-25c433e8-35b1-4e8b-b5fb-4764fe30f179 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:20:56.948694 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-25c433e8-35b1-4e8b-b5fb-4764fe30f179 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] [instance: 302ab8ef-5565-4f9b-9b91-b405d550a90d] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:20:56.957143 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-25c433e8-35b1-4e8b-b5fb-4764fe30f179 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:56.958014 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-25c433e8-35b1-4e8b-b5fb-4764fe30f179 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:56.958890 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-25c433e8-35b1-4e8b-b5fb-4764fe30f179 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:56.959424 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-25c433e8-35b1-4e8b-b5fb-4764fe30f179 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:57.136146 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-f60d4890-51e6-4f9b-a422-7ad648e88af8 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:20:57.137672 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-f60d4890-51e6-4f9b-a422-7ad648e88af8 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: 2306113c-8f98-42fd-8c0c-3dfac98fff21] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:20:57.143279 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-25c433e8-35b1-4e8b-b5fb-4764fe30f179 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1efac6c215148ce8c3ecdce1e9a8742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d392a7d77f46fcb4faa017786796fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:20:57.145985 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-f60d4890-51e6-4f9b-a422-7ad648e88af8 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:57.146663 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-f60d4890-51e6-4f9b-a422-7ad648e88af8 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:57.148694 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-f60d4890-51e6-4f9b-a422-7ad648e88af8 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:57.149950 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-f60d4890-51e6-4f9b-a422-7ad648e88af8 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:57.151633 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-25c433e8-35b1-4e8b-b5fb-4764fe30f179 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] 10.222.0.66 "GET /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d" status: 200 len: 1521 microversion: 2.1 time: 0.209120 Nov 22 12:20:57.152271 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 173/324] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:20:56 2021] GET /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d => generated 1521 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:20:57.184238 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-2dabd760-5f76-4d50-b457-dc590151386d tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:20:57.185167 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-2dabd760-5f76-4d50-b457-dc590151386d tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] [instance: 09a121f0-f7e5-4376-96bf-7008344dfe06] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:20:57.207597 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-2dabd760-5f76-4d50-b457-dc590151386d tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:57.207975 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-2dabd760-5f76-4d50-b457-dc590151386d tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:57.209045 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-2dabd760-5f76-4d50-b457-dc590151386d tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:57.209736 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-2dabd760-5f76-4d50-b457-dc590151386d tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:57.252871 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-2dabd760-5f76-4d50-b457-dc590151386d tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] 10.222.0.66 "GET /compute/v2.1/servers/09a121f0-f7e5-4376-96bf-7008344dfe06/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.072288 Nov 22 12:20:57.253974 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 174/325] 10.222.0.66 () {58 vars in 1301 bytes} [Mon Nov 22 12:20:57 2021] GET /compute/v2.1/servers/09a121f0-f7e5-4376-96bf-7008344dfe06/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 12:20:57.259711 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-d194b9db-495a-4443-a150-bf3cb94c794c tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:20:57.261036 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-d194b9db-495a-4443-a150-bf3cb94c794c tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: c9f6d441-246f-479e-8e88-ea701c0f87ff] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:20:57.271375 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-d194b9db-495a-4443-a150-bf3cb94c794c tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:57.272840 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-d194b9db-495a-4443-a150-bf3cb94c794c tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:57.273700 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-d194b9db-495a-4443-a150-bf3cb94c794c tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:57.274134 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-d194b9db-495a-4443-a150-bf3cb94c794c tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:57.321009 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-f60d4890-51e6-4f9b-a422-7ad648e88af8 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41d885b9b854d8db11da5d325552301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f5dffe9bc3f41c7a2656d194fd02173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:20:57.329007 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-f60d4890-51e6-4f9b-a422-7ad648e88af8 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "GET /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21" status: 200 len: 1548 microversion: 2.1 time: 0.196482 Nov 22 12:20:57.329419 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 152/326] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:20:57 2021] GET /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21 => generated 1548 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:20:57.347581 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-b87997d0-53be-4a06-a82a-21aa86da7817 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:20:57.348067 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-b87997d0-53be-4a06-a82a-21aa86da7817 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: 2306113c-8f98-42fd-8c0c-3dfac98fff21] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:20:57.354246 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-b87997d0-53be-4a06-a82a-21aa86da7817 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:57.354780 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-b87997d0-53be-4a06-a82a-21aa86da7817 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:57.355590 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-b87997d0-53be-4a06-a82a-21aa86da7817 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:57.356021 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-b87997d0-53be-4a06-a82a-21aa86da7817 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:57.356568 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-d194b9db-495a-4443-a150-bf3cb94c794c tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "POST /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff/action" status: 200 len: 28631 microversion: 2.20 time: 0.101296 Nov 22 12:20:57.357210 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 175/327] 10.222.0.66 () {62 vars in 1318 bytes} [Mon Nov 22 12:20:57 2021] POST /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff/action => generated 28631 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 12:20:57.443589 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-b87997d0-53be-4a06-a82a-21aa86da7817 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "GET /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.100409 Nov 22 12:20:57.444175 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 153/328] 10.222.0.66 () {58 vars in 1274 bytes} [Mon Nov 22 12:20:57 2021] GET /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21/os-interface => generated 284 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 22 12:20:57.586129 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-4a9d2ed9-b1c3-49d1-bb74-18cab65c0b02 tempest-VolumesNegativeTest-1241195036 tempest-VolumesNegativeTest-1241195036-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-249347944", "imageRef": "31affc49-b6f0-44da-af65-4c65d72458b9", "flavorRef": "452"}} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:20:57.663034 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.network.neutron [None req-4a9d2ed9-b1c3-49d1-bb74-18cab65c0b02 tempest-VolumesNegativeTest-1241195036 tempest-VolumesNegativeTest-1241195036-project] validate_networks() for None {{(pid=116272) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 22 12:20:57.975057 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.virt.hardware [None req-4a9d2ed9-b1c3-49d1-bb74-18cab65c0b02 tempest-VolumesNegativeTest-1241195036 tempest-VolumesNegativeTest-1241195036-project] Flavor limits 0:0:0 {{(pid=116272) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 22 12:20:57.975521 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.virt.hardware [None req-4a9d2ed9-b1c3-49d1-bb74-18cab65c0b02 tempest-VolumesNegativeTest-1241195036 tempest-VolumesNegativeTest-1241195036-project] Image limits 0:0:0 {{(pid=116272) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 22 12:20:57.976109 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.virt.hardware [None req-4a9d2ed9-b1c3-49d1-bb74-18cab65c0b02 tempest-VolumesNegativeTest-1241195036 tempest-VolumesNegativeTest-1241195036-project] Flavor pref 0:0:0 {{(pid=116272) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 22 12:20:57.976596 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.virt.hardware [None req-4a9d2ed9-b1c3-49d1-bb74-18cab65c0b02 tempest-VolumesNegativeTest-1241195036 tempest-VolumesNegativeTest-1241195036-project] Image pref 0:0:0 {{(pid=116272) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 22 12:20:57.977202 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.virt.hardware [None req-4a9d2ed9-b1c3-49d1-bb74-18cab65c0b02 tempest-VolumesNegativeTest-1241195036 tempest-VolumesNegativeTest-1241195036-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116272) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 22 12:20:57.988847 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-4a9d2ed9-b1c3-49d1-bb74-18cab65c0b02 tempest-VolumesNegativeTest-1241195036 tempest-VolumesNegativeTest-1241195036-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:57.989650 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-4a9d2ed9-b1c3-49d1-bb74-18cab65c0b02 tempest-VolumesNegativeTest-1241195036 tempest-VolumesNegativeTest-1241195036-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:57.990703 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-4a9d2ed9-b1c3-49d1-bb74-18cab65c0b02 tempest-VolumesNegativeTest-1241195036 tempest-VolumesNegativeTest-1241195036-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:57.991181 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-4a9d2ed9-b1c3-49d1-bb74-18cab65c0b02 tempest-VolumesNegativeTest-1241195036 tempest-VolumesNegativeTest-1241195036-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:58.009918 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.quota [None req-4a9d2ed9-b1c3-49d1-bb74-18cab65c0b02 tempest-VolumesNegativeTest-1241195036 tempest-VolumesNegativeTest-1241195036-project] Getting quotas for project ef03c640c58d4cf7af6394cb2ca33af8. Resources: {'ram', 'instances', 'cores'} {{(pid=116272) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 22 12:20:58.014178 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.quota [None req-4a9d2ed9-b1c3-49d1-bb74-18cab65c0b02 tempest-VolumesNegativeTest-1241195036 tempest-VolumesNegativeTest-1241195036-project] Getting quotas for user 624b59c47f79477f8eb4d433c99f4278 and project ef03c640c58d4cf7af6394cb2ca33af8. Resources: {'ram', 'instances', 'cores'} {{(pid=116272) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 22 12:20:58.025970 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-4a9d2ed9-b1c3-49d1-bb74-18cab65c0b02 tempest-VolumesNegativeTest-1241195036 tempest-VolumesNegativeTest-1241195036-project] Going to run 1 instances... {{(pid=116272) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 22 12:20:58.028557 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-4a9d2ed9-b1c3-49d1-bb74-18cab65c0b02 tempest-VolumesNegativeTest-1241195036 tempest-VolumesNegativeTest-1241195036-project] [instance: 185570a5-ac44-4263-bf37-09b34256de29] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='31affc49-b6f0-44da-af65-4c65d72458b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116272) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 22 12:20:58.077170 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-4a9d2ed9-b1c3-49d1-bb74-18cab65c0b02 tempest-VolumesNegativeTest-1241195036 tempest-VolumesNegativeTest-1241195036-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.498490 Nov 22 12:20:58.078167 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 176/329] 10.222.0.66 () {60 vars in 1146 bytes} [Mon Nov 22 12:20:57 2021] POST /compute/v2.1/servers => generated 380 bytes in 501 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 22 12:20:58.089177 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-edff0acf-8c1d-4635-9b14-cad161e8f52c tempest-VolumesNegativeTest-1241195036 tempest-VolumesNegativeTest-1241195036-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:20:58.089784 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-edff0acf-8c1d-4635-9b14-cad161e8f52c tempest-VolumesNegativeTest-1241195036 tempest-VolumesNegativeTest-1241195036-project] [instance: 185570a5-ac44-4263-bf37-09b34256de29] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:20:58.156780 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-edff0acf-8c1d-4635-9b14-cad161e8f52c tempest-VolumesNegativeTest-1241195036 tempest-VolumesNegativeTest-1241195036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624b59c47f79477f8eb4d433c99f4278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef03c640c58d4cf7af6394cb2ca33af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:20:58.175156 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-edff0acf-8c1d-4635-9b14-cad161e8f52c tempest-VolumesNegativeTest-1241195036 tempest-VolumesNegativeTest-1241195036-project] 10.222.0.66 "GET /compute/v2.1/servers/185570a5-ac44-4263-bf37-09b34256de29" status: 200 len: 1214 microversion: 2.1 time: 0.080054 Nov 22 12:20:58.175156 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 154/330] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:20:58 2021] GET /compute/v2.1/servers/185570a5-ac44-4263-bf37-09b34256de29 => generated 1214 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:20:58.175483 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-4c0a395f-2cc1-4764-b0be-8e000d93bd8c tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:20:58.175483 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-4c0a395f-2cc1-4764-b0be-8e000d93bd8c tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] [instance: 302ab8ef-5565-4f9b-9b91-b405d550a90d] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:20:58.186593 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-4c0a395f-2cc1-4764-b0be-8e000d93bd8c tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:58.187209 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-4c0a395f-2cc1-4764-b0be-8e000d93bd8c tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:58.190299 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-4c0a395f-2cc1-4764-b0be-8e000d93bd8c tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:58.191023 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-4c0a395f-2cc1-4764-b0be-8e000d93bd8c tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:58.265121 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-d5c5ba7b-606b-4fa1-9842-6c55db3cc47e tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:20:58.266237 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-d5c5ba7b-606b-4fa1-9842-6c55db3cc47e tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] [instance: 09a121f0-f7e5-4376-96bf-7008344dfe06] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:20:58.285465 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-d5c5ba7b-606b-4fa1-9842-6c55db3cc47e tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:58.286906 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-d5c5ba7b-606b-4fa1-9842-6c55db3cc47e tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:58.288693 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-d5c5ba7b-606b-4fa1-9842-6c55db3cc47e tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:58.291929 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-d5c5ba7b-606b-4fa1-9842-6c55db3cc47e tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:58.359587 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-d5c5ba7b-606b-4fa1-9842-6c55db3cc47e tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] 10.222.0.66 "GET /compute/v2.1/servers/09a121f0-f7e5-4376-96bf-7008344dfe06/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.097661 Nov 22 12:20:58.360715 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 155/331] 10.222.0.66 () {58 vars in 1301 bytes} [Mon Nov 22 12:20:58 2021] GET /compute/v2.1/servers/09a121f0-f7e5-4376-96bf-7008344dfe06/os-volume_attachments => generated 25 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 22 12:20:58.376809 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-dab25593-8c0d-43cc-b99c-59ceb296200c tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:20:58.377738 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-dab25593-8c0d-43cc-b99c-59ceb296200c tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: c9f6d441-246f-479e-8e88-ea701c0f87ff] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:20:58.401598 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-dab25593-8c0d-43cc-b99c-59ceb296200c tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:58.402049 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-dab25593-8c0d-43cc-b99c-59ceb296200c tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:58.402846 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-dab25593-8c0d-43cc-b99c-59ceb296200c tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:58.403299 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-dab25593-8c0d-43cc-b99c-59ceb296200c tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:58.436876 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-4c0a395f-2cc1-4764-b0be-8e000d93bd8c tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1efac6c215148ce8c3ecdce1e9a8742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d392a7d77f46fcb4faa017786796fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:20:58.448201 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-4c0a395f-2cc1-4764-b0be-8e000d93bd8c tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] 10.222.0.66 "GET /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d" status: 200 len: 1521 microversion: 2.1 time: 0.281024 Nov 22 12:20:58.449084 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 177/332] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:20:58 2021] GET /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d => generated 1521 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 12:20:58.502506 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-dab25593-8c0d-43cc-b99c-59ceb296200c tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "POST /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff/action" status: 200 len: 28631 microversion: 2.20 time: 0.136586 Nov 22 12:20:58.504323 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 156/333] 10.222.0.66 () {62 vars in 1318 bytes} [Mon Nov 22 12:20:58 2021] POST /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff/action => generated 28631 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 12:20:58.603158 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-3f702ba5-1bbe-42f6-9a0d-35daf7f11dfb tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1638341358", "imageRef": "31affc49-b6f0-44da-af65-4c65d72458b9", "flavorRef": "452", "networks": [{"uuid": "1a398bbd-8494-4c78-9a7f-9328646aea45"}]}} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:20:58.685316 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.network.neutron [None req-3f702ba5-1bbe-42f6-9a0d-35daf7f11dfb tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] validate_networks() for [('1a398bbd-8494-4c78-9a7f-9328646aea45', None, None, None, None, None)] {{(pid=116272) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 22 12:20:58.846327 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-b665a855-1e81-42d8-9a99-1418d0bd7511 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:20:58.847492 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-b665a855-1e81-42d8-9a99-1418d0bd7511 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: 2306113c-8f98-42fd-8c0c-3dfac98fff21] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:20:58.860168 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-b665a855-1e81-42d8-9a99-1418d0bd7511 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:58.861308 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-b665a855-1e81-42d8-9a99-1418d0bd7511 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:58.876683 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-b665a855-1e81-42d8-9a99-1418d0bd7511 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:58.877155 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-b665a855-1e81-42d8-9a99-1418d0bd7511 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:58.980802 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-b665a855-1e81-42d8-9a99-1418d0bd7511 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "POST /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21/action" status: 200 len: 14 microversion: 2.1 time: 0.139907 Nov 22 12:20:58.981437 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 157/334] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Nov 22 12:20:58 2021] POST /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21/action => generated 14 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 22 12:20:58.994893 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [req-c9c05afc-75df-4eaa-a676-c7a54d85dd68 req-14a64969-ef5a-4355-8433-6612bde0166f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2306113c-8f98-42fd-8c0c-3dfac98fff21", "tag": "0b19f5ef-ff09-43ae-866e-7b3d6c9fc45c"}]} {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:20:58.997007 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 12:20:58.997007 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: warnings.warn(msg) Nov 22 12:20:59.006968 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [req-c9c05afc-75df-4eaa-a676-c7a54d85dd68 req-14a64969-ef5a-4355-8433-6612bde0166f service nova] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:59.008302 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [req-c9c05afc-75df-4eaa-a676-c7a54d85dd68 req-14a64969-ef5a-4355-8433-6612bde0166f service nova] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:59.030259 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.compute.server_external_events [req-c9c05afc-75df-4eaa-a676-c7a54d85dd68 req-14a64969-ef5a-4355-8433-6612bde0166f service nova] Creating event network-changed:0b19f5ef-ff09-43ae-866e-7b3d6c9fc45c for instance 2306113c-8f98-42fd-8c0c-3dfac98fff21 on hv-cinder-76845 Nov 22 12:20:59.036670 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [req-c9c05afc-75df-4eaa-a676-c7a54d85dd68 req-14a64969-ef5a-4355-8433-6612bde0166f service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050499 Nov 22 12:20:59.037547 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 158/335] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Nov 22 12:20:58 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 12:20:59.184442 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-15271edb-54f8-4d76-a585-5a6fe1d9f9fa tempest-VolumesNegativeTest-1241195036 tempest-VolumesNegativeTest-1241195036-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:20:59.185999 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-15271edb-54f8-4d76-a585-5a6fe1d9f9fa tempest-VolumesNegativeTest-1241195036 tempest-VolumesNegativeTest-1241195036-project] [instance: 185570a5-ac44-4263-bf37-09b34256de29] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:20:59.194172 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-15271edb-54f8-4d76-a585-5a6fe1d9f9fa tempest-VolumesNegativeTest-1241195036 tempest-VolumesNegativeTest-1241195036-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:59.194975 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-15271edb-54f8-4d76-a585-5a6fe1d9f9fa tempest-VolumesNegativeTest-1241195036 tempest-VolumesNegativeTest-1241195036-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:59.196116 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-15271edb-54f8-4d76-a585-5a6fe1d9f9fa tempest-VolumesNegativeTest-1241195036 tempest-VolumesNegativeTest-1241195036-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:59.196785 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-15271edb-54f8-4d76-a585-5a6fe1d9f9fa tempest-VolumesNegativeTest-1241195036 tempest-VolumesNegativeTest-1241195036-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:59.281261 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-15271edb-54f8-4d76-a585-5a6fe1d9f9fa tempest-VolumesNegativeTest-1241195036 tempest-VolumesNegativeTest-1241195036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624b59c47f79477f8eb4d433c99f4278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef03c640c58d4cf7af6394cb2ca33af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:20:59.295054 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.virt.hardware [None req-3f702ba5-1bbe-42f6-9a0d-35daf7f11dfb tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Flavor limits 0:0:0 {{(pid=116272) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 22 12:20:59.295568 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.virt.hardware [None req-3f702ba5-1bbe-42f6-9a0d-35daf7f11dfb tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Image limits 0:0:0 {{(pid=116272) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 22 12:20:59.296173 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.virt.hardware [None req-3f702ba5-1bbe-42f6-9a0d-35daf7f11dfb tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Flavor pref 0:0:0 {{(pid=116272) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 22 12:20:59.296642 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.virt.hardware [None req-3f702ba5-1bbe-42f6-9a0d-35daf7f11dfb tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Image pref 0:0:0 {{(pid=116272) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 22 12:20:59.297137 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.virt.hardware [None req-3f702ba5-1bbe-42f6-9a0d-35daf7f11dfb tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116272) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 22 12:20:59.304834 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-15271edb-54f8-4d76-a585-5a6fe1d9f9fa tempest-VolumesNegativeTest-1241195036 tempest-VolumesNegativeTest-1241195036-project] 10.222.0.66 "GET /compute/v2.1/servers/185570a5-ac44-4263-bf37-09b34256de29" status: 200 len: 1266 microversion: 2.1 time: 0.125392 Nov 22 12:20:59.308453 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-3f702ba5-1bbe-42f6-9a0d-35daf7f11dfb tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:59.308999 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-3f702ba5-1bbe-42f6-9a0d-35daf7f11dfb tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:59.310561 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-3f702ba5-1bbe-42f6-9a0d-35daf7f11dfb tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:59.311210 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-3f702ba5-1bbe-42f6-9a0d-35daf7f11dfb tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:59.318311 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 159/336] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:20:59 2021] GET /compute/v2.1/servers/185570a5-ac44-4263-bf37-09b34256de29 => generated 1266 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:20:59.330017 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.quota [None req-3f702ba5-1bbe-42f6-9a0d-35daf7f11dfb tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Getting quotas for project 5319fd2dee9b4b47b98f59bca1572ac8. Resources: {'ram', 'instances', 'cores'} {{(pid=116272) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 22 12:20:59.335637 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.quota [None req-3f702ba5-1bbe-42f6-9a0d-35daf7f11dfb tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Getting quotas for user 8a4b581fa25045cea9585ae4e707585d and project 5319fd2dee9b4b47b98f59bca1572ac8. Resources: {'ram', 'instances', 'cores'} {{(pid=116272) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 22 12:20:59.347649 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-3f702ba5-1bbe-42f6-9a0d-35daf7f11dfb tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Going to run 1 instances... {{(pid=116272) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 22 12:20:59.349890 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-3f702ba5-1bbe-42f6-9a0d-35daf7f11dfb tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] [instance: d457eff7-4539-4ee1-8c94-c51cd4b5b2c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='31affc49-b6f0-44da-af65-4c65d72458b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116272) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 22 12:20:59.403210 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-3f702ba5-1bbe-42f6-9a0d-35daf7f11dfb tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.803672 Nov 22 12:20:59.404122 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 178/337] 10.222.0.66 () {60 vars in 1146 bytes} [Mon Nov 22 12:20:58 2021] POST /compute/v2.1/servers => generated 380 bytes in 805 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 22 12:20:59.414241 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-ef375466-571a-4e2b-b00a-63df3bfd3024 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:20:59.415196 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-ef375466-571a-4e2b-b00a-63df3bfd3024 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] [instance: d457eff7-4539-4ee1-8c94-c51cd4b5b2c1] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:20:59.469491 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-968da357-4060-4e98-9b18-2b74a42d5870 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:20:59.471354 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-968da357-4060-4e98-9b18-2b74a42d5870 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] [instance: 302ab8ef-5565-4f9b-9b91-b405d550a90d] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:20:59.490174 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-968da357-4060-4e98-9b18-2b74a42d5870 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:59.491622 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-968da357-4060-4e98-9b18-2b74a42d5870 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:59.494176 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-968da357-4060-4e98-9b18-2b74a42d5870 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:59.495086 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-968da357-4060-4e98-9b18-2b74a42d5870 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:59.506804 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-ef375466-571a-4e2b-b00a-63df3bfd3024 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b581fa25045cea9585ae4e707585d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5319fd2dee9b4b47b98f59bca1572ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:20:59.514211 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-ef375466-571a-4e2b-b00a-63df3bfd3024 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] 10.222.0.66 "GET /compute/v2.1/servers/d457eff7-4539-4ee1-8c94-c51cd4b5b2c1" status: 200 len: 1218 microversion: 2.1 time: 0.103479 Nov 22 12:20:59.514812 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 160/338] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:20:59 2021] GET /compute/v2.1/servers/d457eff7-4539-4ee1-8c94-c51cd4b5b2c1 => generated 1218 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:20:59.569951 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-b8ea771e-afe3-4a5a-9f4d-eada119bc9b9 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:20:59.571081 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-b8ea771e-afe3-4a5a-9f4d-eada119bc9b9 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: c9f6d441-246f-479e-8e88-ea701c0f87ff] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:20:59.586513 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-b8ea771e-afe3-4a5a-9f4d-eada119bc9b9 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:59.587013 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-b8ea771e-afe3-4a5a-9f4d-eada119bc9b9 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:59.587927 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-b8ea771e-afe3-4a5a-9f4d-eada119bc9b9 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:20:59.588371 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-b8ea771e-afe3-4a5a-9f4d-eada119bc9b9 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:20:59.732641 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-b8ea771e-afe3-4a5a-9f4d-eada119bc9b9 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "POST /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff/action" status: 200 len: 28631 microversion: 2.20 time: 0.168491 Nov 22 12:20:59.733323 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 161/339] 10.222.0.66 () {62 vars in 1318 bytes} [Mon Nov 22 12:20:59 2021] POST /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff/action => generated 28631 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 12:20:59.753209 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-968da357-4060-4e98-9b18-2b74a42d5870 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1efac6c215148ce8c3ecdce1e9a8742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d392a7d77f46fcb4faa017786796fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:20:59.761608 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-968da357-4060-4e98-9b18-2b74a42d5870 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] 10.222.0.66 "GET /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d" status: 200 len: 1521 microversion: 2.1 time: 0.298321 Nov 22 12:20:59.772026 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 179/340] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:20:59 2021] GET /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d => generated 1521 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 12:20:59.993946 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-6f23e1a7-bd90-4f39-b86f-f065dd0ab40d tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:20:59.995803 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-6f23e1a7-bd90-4f39-b86f-f065dd0ab40d tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: 2306113c-8f98-42fd-8c0c-3dfac98fff21] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:00.009038 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-6f23e1a7-bd90-4f39-b86f-f065dd0ab40d tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:00.009545 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-6f23e1a7-bd90-4f39-b86f-f065dd0ab40d tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:00.010385 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-6f23e1a7-bd90-4f39-b86f-f065dd0ab40d tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:00.010841 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-6f23e1a7-bd90-4f39-b86f-f065dd0ab40d tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:00.147274 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-6f23e1a7-bd90-4f39-b86f-f065dd0ab40d tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "POST /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21/action" status: 200 len: 14 microversion: 2.1 time: 0.154625 Nov 22 12:21:00.155565 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 162/341] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Nov 22 12:20:59 2021] POST /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21/action => generated 14 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 22 12:21:00.332713 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-49cde94e-ad46-4e17-848b-3ed6b01c18f0 tempest-VolumesNegativeTest-1241195036 tempest-VolumesNegativeTest-1241195036-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:21:00.333367 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-49cde94e-ad46-4e17-848b-3ed6b01c18f0 tempest-VolumesNegativeTest-1241195036 tempest-VolumesNegativeTest-1241195036-project] [instance: 185570a5-ac44-4263-bf37-09b34256de29] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:00.340889 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-49cde94e-ad46-4e17-848b-3ed6b01c18f0 tempest-VolumesNegativeTest-1241195036 tempest-VolumesNegativeTest-1241195036-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:00.341598 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-49cde94e-ad46-4e17-848b-3ed6b01c18f0 tempest-VolumesNegativeTest-1241195036 tempest-VolumesNegativeTest-1241195036-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:00.342586 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-49cde94e-ad46-4e17-848b-3ed6b01c18f0 tempest-VolumesNegativeTest-1241195036 tempest-VolumesNegativeTest-1241195036-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:00.343026 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-49cde94e-ad46-4e17-848b-3ed6b01c18f0 tempest-VolumesNegativeTest-1241195036 tempest-VolumesNegativeTest-1241195036-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:00.444800 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-49cde94e-ad46-4e17-848b-3ed6b01c18f0 tempest-VolumesNegativeTest-1241195036 tempest-VolumesNegativeTest-1241195036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624b59c47f79477f8eb4d433c99f4278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef03c640c58d4cf7af6394cb2ca33af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:21:00.469004 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-49cde94e-ad46-4e17-848b-3ed6b01c18f0 tempest-VolumesNegativeTest-1241195036 tempest-VolumesNegativeTest-1241195036-project] 10.222.0.66 "GET /compute/v2.1/servers/185570a5-ac44-4263-bf37-09b34256de29" status: 200 len: 1272 microversion: 2.1 time: 0.139203 Nov 22 12:21:00.470061 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 180/342] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:21:00 2021] GET /compute/v2.1/servers/185570a5-ac44-4263-bf37-09b34256de29 => generated 1272 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:21:00.534472 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-b4656069-61c2-40f7-85c8-ddb0edb1ebec tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:21:00.536259 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-b4656069-61c2-40f7-85c8-ddb0edb1ebec tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] [instance: d457eff7-4539-4ee1-8c94-c51cd4b5b2c1] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:00.546465 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-b4656069-61c2-40f7-85c8-ddb0edb1ebec tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:00.547426 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-b4656069-61c2-40f7-85c8-ddb0edb1ebec tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:00.548531 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-b4656069-61c2-40f7-85c8-ddb0edb1ebec tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:00.549423 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-b4656069-61c2-40f7-85c8-ddb0edb1ebec tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:00.648633 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-b4656069-61c2-40f7-85c8-ddb0edb1ebec tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b581fa25045cea9585ae4e707585d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5319fd2dee9b4b47b98f59bca1572ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:21:00.655991 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-b4656069-61c2-40f7-85c8-ddb0edb1ebec tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] 10.222.0.66 "GET /compute/v2.1/servers/d457eff7-4539-4ee1-8c94-c51cd4b5b2c1" status: 200 len: 1270 microversion: 2.1 time: 0.128593 Nov 22 12:21:00.659617 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 163/343] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:21:00 2021] GET /compute/v2.1/servers/d457eff7-4539-4ee1-8c94-c51cd4b5b2c1 => generated 1270 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:21:00.745313 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-9bbeca8f-e5c0-45a6-8a18-bf297d656999 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:21:00.746340 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-9bbeca8f-e5c0-45a6-8a18-bf297d656999 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: c9f6d441-246f-479e-8e88-ea701c0f87ff] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:00.752949 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-9bbeca8f-e5c0-45a6-8a18-bf297d656999 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:00.753392 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-9bbeca8f-e5c0-45a6-8a18-bf297d656999 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:00.754148 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-9bbeca8f-e5c0-45a6-8a18-bf297d656999 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:00.754870 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-9bbeca8f-e5c0-45a6-8a18-bf297d656999 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:00.779511 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-e714923f-aa83-4fd8-9f15-643ebe370bcd tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:21:00.780497 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-e714923f-aa83-4fd8-9f15-643ebe370bcd tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] [instance: 302ab8ef-5565-4f9b-9b91-b405d550a90d] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:00.788775 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-e714923f-aa83-4fd8-9f15-643ebe370bcd tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:00.789228 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-e714923f-aa83-4fd8-9f15-643ebe370bcd tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:00.790370 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-e714923f-aa83-4fd8-9f15-643ebe370bcd tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:00.790809 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-e714923f-aa83-4fd8-9f15-643ebe370bcd tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:00.841577 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-9bbeca8f-e5c0-45a6-8a18-bf297d656999 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "POST /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff/action" status: 200 len: 28631 microversion: 2.20 time: 0.099956 Nov 22 12:21:00.843030 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 181/344] 10.222.0.66 () {62 vars in 1318 bytes} [Mon Nov 22 12:21:00 2021] POST /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff/action => generated 28631 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 12:21:00.930464 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-e714923f-aa83-4fd8-9f15-643ebe370bcd tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1efac6c215148ce8c3ecdce1e9a8742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d392a7d77f46fcb4faa017786796fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:21:00.939155 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-e714923f-aa83-4fd8-9f15-643ebe370bcd tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] 10.222.0.66 "GET /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d" status: 200 len: 1521 microversion: 2.1 time: 0.163391 Nov 22 12:21:00.940016 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 164/345] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:21:00 2021] GET /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 12:21:01.161046 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-fee2b2eb-2d19-41ec-94d8-97a1352120a3 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:21:01.163039 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-fee2b2eb-2d19-41ec-94d8-97a1352120a3 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: 2306113c-8f98-42fd-8c0c-3dfac98fff21] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:01.173272 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-fee2b2eb-2d19-41ec-94d8-97a1352120a3 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:01.176862 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-fee2b2eb-2d19-41ec-94d8-97a1352120a3 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:01.178364 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-fee2b2eb-2d19-41ec-94d8-97a1352120a3 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:01.179571 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-fee2b2eb-2d19-41ec-94d8-97a1352120a3 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:01.490641 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-833cc602-e978-44b2-a462-d56d1ebb67a1 tempest-VolumesNegativeTest-1241195036 tempest-VolumesNegativeTest-1241195036-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:21:01.491610 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-833cc602-e978-44b2-a462-d56d1ebb67a1 tempest-VolumesNegativeTest-1241195036 tempest-VolumesNegativeTest-1241195036-project] [instance: 185570a5-ac44-4263-bf37-09b34256de29] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:01.501836 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-833cc602-e978-44b2-a462-d56d1ebb67a1 tempest-VolumesNegativeTest-1241195036 tempest-VolumesNegativeTest-1241195036-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:01.502449 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-833cc602-e978-44b2-a462-d56d1ebb67a1 tempest-VolumesNegativeTest-1241195036 tempest-VolumesNegativeTest-1241195036-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:01.503433 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-833cc602-e978-44b2-a462-d56d1ebb67a1 tempest-VolumesNegativeTest-1241195036 tempest-VolumesNegativeTest-1241195036-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:01.503976 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-833cc602-e978-44b2-a462-d56d1ebb67a1 tempest-VolumesNegativeTest-1241195036 tempest-VolumesNegativeTest-1241195036-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:01.693044 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-833cc602-e978-44b2-a462-d56d1ebb67a1 tempest-VolumesNegativeTest-1241195036 tempest-VolumesNegativeTest-1241195036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624b59c47f79477f8eb4d433c99f4278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef03c640c58d4cf7af6394cb2ca33af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:21:01.706345 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-833cc602-e978-44b2-a462-d56d1ebb67a1 tempest-VolumesNegativeTest-1241195036 tempest-VolumesNegativeTest-1241195036-project] 10.222.0.66 "GET /compute/v2.1/servers/185570a5-ac44-4263-bf37-09b34256de29" status: 200 len: 1314 microversion: 2.1 time: 0.222096 Nov 22 12:21:01.709758 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 165/346] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:21:01 2021] GET /compute/v2.1/servers/185570a5-ac44-4263-bf37-09b34256de29 => generated 1314 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 12:21:01.716511 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-6b595b27-e88c-45a1-b07e-a97d5095d679 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:21:01.717624 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-6b595b27-e88c-45a1-b07e-a97d5095d679 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] [instance: d457eff7-4539-4ee1-8c94-c51cd4b5b2c1] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:01.726989 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-6b595b27-e88c-45a1-b07e-a97d5095d679 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:01.728376 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-6b595b27-e88c-45a1-b07e-a97d5095d679 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:01.729424 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-6b595b27-e88c-45a1-b07e-a97d5095d679 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:01.730238 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-6b595b27-e88c-45a1-b07e-a97d5095d679 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:01.821984 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-6b595b27-e88c-45a1-b07e-a97d5095d679 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b581fa25045cea9585ae4e707585d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5319fd2dee9b4b47b98f59bca1572ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:21:01.829447 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-6b595b27-e88c-45a1-b07e-a97d5095d679 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] 10.222.0.66 "GET /compute/v2.1/servers/d457eff7-4539-4ee1-8c94-c51cd4b5b2c1" status: 200 len: 1276 microversion: 2.1 time: 0.117482 Nov 22 12:21:01.829968 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 166/347] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:21:01 2021] GET /compute/v2.1/servers/d457eff7-4539-4ee1-8c94-c51cd4b5b2c1 => generated 1276 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:21:01.854384 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-3822e20b-712e-4b1d-b07f-a1ce9afec1bc tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:21:01.855221 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-3822e20b-712e-4b1d-b07f-a1ce9afec1bc tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: c9f6d441-246f-479e-8e88-ea701c0f87ff] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:01.861693 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-3822e20b-712e-4b1d-b07f-a1ce9afec1bc tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:01.862384 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-3822e20b-712e-4b1d-b07f-a1ce9afec1bc tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:01.863403 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-3822e20b-712e-4b1d-b07f-a1ce9afec1bc tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:01.863837 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-3822e20b-712e-4b1d-b07f-a1ce9afec1bc tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:04.563439 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-3822e20b-712e-4b1d-b07f-a1ce9afec1bc tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "POST /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff/action" status: 200 len: 28631 microversion: 2.20 time: 2.711976 Nov 22 12:21:04.568046 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 167/348] 10.222.0.66 () {62 vars in 1318 bytes} [Mon Nov 22 12:21:01 2021] POST /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff/action => generated 28631 bytes in 2715 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 22 12:21:04.572362 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-cbf87cde-731b-4a24-8c51-df6b16178bd4 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:21:04.573377 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-cbf87cde-731b-4a24-8c51-df6b16178bd4 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] [instance: 302ab8ef-5565-4f9b-9b91-b405d550a90d] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:04.578878 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-fee2b2eb-2d19-41ec-94d8-97a1352120a3 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "POST /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21/action" status: 200 len: 14 microversion: 2.1 time: 3.425395 Nov 22 12:21:04.580040 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 182/349] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Nov 22 12:21:01 2021] POST /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21/action => generated 14 bytes in 3428 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 22 12:21:04.589135 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [req-26c66b27-3a36-49d0-ba31-8f34e82430bc req-47a08867-97e1-4c43-9913-3af37209a853 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "185570a5-ac44-4263-bf37-09b34256de29", "tag": "4064eb13-0c50-40e5-a2ea-9dd0aabf8848"}]} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:21:04.596282 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-cbf87cde-731b-4a24-8c51-df6b16178bd4 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:04.597569 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 12:21:04.597569 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: warnings.warn(msg) Nov 22 12:21:04.598100 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-cbf87cde-731b-4a24-8c51-df6b16178bd4 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:04.599155 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-cbf87cde-731b-4a24-8c51-df6b16178bd4 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:04.600454 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-cbf87cde-731b-4a24-8c51-df6b16178bd4 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:04.630195 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [req-26c66b27-3a36-49d0-ba31-8f34e82430bc req-47a08867-97e1-4c43-9913-3af37209a853 service nova] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:04.632294 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [req-26c66b27-3a36-49d0-ba31-8f34e82430bc req-47a08867-97e1-4c43-9913-3af37209a853 service nova] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:04.649196 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.compute.server_external_events [req-26c66b27-3a36-49d0-ba31-8f34e82430bc req-47a08867-97e1-4c43-9913-3af37209a853 service nova] Creating event network-changed:4064eb13-0c50-40e5-a2ea-9dd0aabf8848 for instance 185570a5-ac44-4263-bf37-09b34256de29 on hv-cinder-76845 Nov 22 12:21:04.656018 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [req-26c66b27-3a36-49d0-ba31-8f34e82430bc req-47a08867-97e1-4c43-9913-3af37209a853 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074296 Nov 22 12:21:04.657751 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 183/350] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Nov 22 12:21:04 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 12:21:04.664197 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-fee45be0-698d-42d2-800b-36c9af0d29f8 tempest-VolumesNegativeTest-1241195036 tempest-VolumesNegativeTest-1241195036-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:21:04.665519 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-fee45be0-698d-42d2-800b-36c9af0d29f8 tempest-VolumesNegativeTest-1241195036 tempest-VolumesNegativeTest-1241195036-project] [instance: 185570a5-ac44-4263-bf37-09b34256de29] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:04.677931 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-fee45be0-698d-42d2-800b-36c9af0d29f8 tempest-VolumesNegativeTest-1241195036 tempest-VolumesNegativeTest-1241195036-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:04.678596 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-fee45be0-698d-42d2-800b-36c9af0d29f8 tempest-VolumesNegativeTest-1241195036 tempest-VolumesNegativeTest-1241195036-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:04.681599 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-fee45be0-698d-42d2-800b-36c9af0d29f8 tempest-VolumesNegativeTest-1241195036 tempest-VolumesNegativeTest-1241195036-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:04.682330 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-fee45be0-698d-42d2-800b-36c9af0d29f8 tempest-VolumesNegativeTest-1241195036 tempest-VolumesNegativeTest-1241195036-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:04.826114 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-cbf87cde-731b-4a24-8c51-df6b16178bd4 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1efac6c215148ce8c3ecdce1e9a8742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d392a7d77f46fcb4faa017786796fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:21:04.851003 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-cbf87cde-731b-4a24-8c51-df6b16178bd4 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] 10.222.0.66 "GET /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d" status: 200 len: 1521 microversion: 2.1 time: 0.284696 Nov 22 12:21:04.852191 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 168/351] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:21:04 2021] GET /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d => generated 1521 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:21:04.861948 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-285a4d36-1334-4edf-862a-10ad298f794e tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:21:04.861948 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-285a4d36-1334-4edf-862a-10ad298f794e tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] [instance: d457eff7-4539-4ee1-8c94-c51cd4b5b2c1] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:04.873222 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-285a4d36-1334-4edf-862a-10ad298f794e tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:04.874239 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-285a4d36-1334-4edf-862a-10ad298f794e tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:04.879823 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-285a4d36-1334-4edf-862a-10ad298f794e tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:04.879823 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-285a4d36-1334-4edf-862a-10ad298f794e tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:05.011056 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-285a4d36-1334-4edf-862a-10ad298f794e tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b581fa25045cea9585ae4e707585d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5319fd2dee9b4b47b98f59bca1572ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:21:05.013228 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-fee45be0-698d-42d2-800b-36c9af0d29f8 tempest-VolumesNegativeTest-1241195036 tempest-VolumesNegativeTest-1241195036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624b59c47f79477f8eb4d433c99f4278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef03c640c58d4cf7af6394cb2ca33af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:21:05.019853 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-285a4d36-1334-4edf-862a-10ad298f794e tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] 10.222.0.66 "GET /compute/v2.1/servers/d457eff7-4539-4ee1-8c94-c51cd4b5b2c1" status: 200 len: 1276 microversion: 2.1 time: 0.165834 Nov 22 12:21:05.020526 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 169/352] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:21:04 2021] GET /compute/v2.1/servers/d457eff7-4539-4ee1-8c94-c51cd4b5b2c1 => generated 1276 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:21:05.024963 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-fee45be0-698d-42d2-800b-36c9af0d29f8 tempest-VolumesNegativeTest-1241195036 tempest-VolumesNegativeTest-1241195036-project] 10.222.0.66 "GET /compute/v2.1/servers/185570a5-ac44-4263-bf37-09b34256de29" status: 200 len: 1314 microversion: 2.1 time: 0.365822 Nov 22 12:21:05.035449 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 184/353] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:21:04 2021] GET /compute/v2.1/servers/185570a5-ac44-4263-bf37-09b34256de29 => generated 1314 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:21:05.575991 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-f34599e0-2d41-422f-94b9-a27937f2842d tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:21:05.577494 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-f34599e0-2d41-422f-94b9-a27937f2842d tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: c9f6d441-246f-479e-8e88-ea701c0f87ff] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:05.590981 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-67fc9d7b-4d62-48b2-a287-49af81c67b06 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:21:05.592086 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-67fc9d7b-4d62-48b2-a287-49af81c67b06 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: 2306113c-8f98-42fd-8c0c-3dfac98fff21] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:05.598727 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-f34599e0-2d41-422f-94b9-a27937f2842d tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:05.599173 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-f34599e0-2d41-422f-94b9-a27937f2842d tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:05.599991 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-f34599e0-2d41-422f-94b9-a27937f2842d tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:05.600414 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-f34599e0-2d41-422f-94b9-a27937f2842d tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:05.603916 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-67fc9d7b-4d62-48b2-a287-49af81c67b06 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:05.604357 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-67fc9d7b-4d62-48b2-a287-49af81c67b06 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:05.605364 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-67fc9d7b-4d62-48b2-a287-49af81c67b06 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:05.605909 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-67fc9d7b-4d62-48b2-a287-49af81c67b06 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:05.726024 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-67fc9d7b-4d62-48b2-a287-49af81c67b06 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "POST /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21/action" status: 200 len: 14 microversion: 2.1 time: 0.138473 Nov 22 12:21:05.726673 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 185/354] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Nov 22 12:21:05 2021] POST /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21/action => generated 14 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 22 12:21:05.731678 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-f34599e0-2d41-422f-94b9-a27937f2842d tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "POST /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff/action" status: 200 len: 28631 microversion: 2.20 time: 0.159172 Nov 22 12:21:05.733673 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 170/355] 10.222.0.66 () {62 vars in 1318 bytes} [Mon Nov 22 12:21:05 2021] POST /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff/action => generated 28631 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 12:21:05.869232 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-60cd9e65-532e-4f73-82d3-198d0ceef539 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:21:05.870349 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-60cd9e65-532e-4f73-82d3-198d0ceef539 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] [instance: 302ab8ef-5565-4f9b-9b91-b405d550a90d] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:05.878314 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-60cd9e65-532e-4f73-82d3-198d0ceef539 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:05.878859 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-60cd9e65-532e-4f73-82d3-198d0ceef539 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:05.879964 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-60cd9e65-532e-4f73-82d3-198d0ceef539 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:05.880486 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-60cd9e65-532e-4f73-82d3-198d0ceef539 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:06.047794 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-90159ce3-ec98-4013-83d2-cec640e8a630 tempest-VolumesNegativeTest-1241195036 tempest-VolumesNegativeTest-1241195036-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:21:06.053245 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-90159ce3-ec98-4013-83d2-cec640e8a630 tempest-VolumesNegativeTest-1241195036 tempest-VolumesNegativeTest-1241195036-project] [instance: 185570a5-ac44-4263-bf37-09b34256de29] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:06.059906 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-90159ce3-ec98-4013-83d2-cec640e8a630 tempest-VolumesNegativeTest-1241195036 tempest-VolumesNegativeTest-1241195036-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:06.060782 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-90159ce3-ec98-4013-83d2-cec640e8a630 tempest-VolumesNegativeTest-1241195036 tempest-VolumesNegativeTest-1241195036-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:06.062247 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-90159ce3-ec98-4013-83d2-cec640e8a630 tempest-VolumesNegativeTest-1241195036 tempest-VolumesNegativeTest-1241195036-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:06.062700 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-90159ce3-ec98-4013-83d2-cec640e8a630 tempest-VolumesNegativeTest-1241195036 tempest-VolumesNegativeTest-1241195036-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:06.068117 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-60cd9e65-532e-4f73-82d3-198d0ceef539 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1efac6c215148ce8c3ecdce1e9a8742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d392a7d77f46fcb4faa017786796fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:21:06.076539 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-60cd9e65-532e-4f73-82d3-198d0ceef539 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] 10.222.0.66 "GET /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d" status: 200 len: 1521 microversion: 2.1 time: 0.211578 Nov 22 12:21:06.077124 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 171/356] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:21:05 2021] GET /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d => generated 1521 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:21:06.093680 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-244fbc5b-096d-4df1-937f-72494824b3e9 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:21:06.094572 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-244fbc5b-096d-4df1-937f-72494824b3e9 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] [instance: d457eff7-4539-4ee1-8c94-c51cd4b5b2c1] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:06.115206 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-244fbc5b-096d-4df1-937f-72494824b3e9 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:06.115845 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-244fbc5b-096d-4df1-937f-72494824b3e9 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:06.116743 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-244fbc5b-096d-4df1-937f-72494824b3e9 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:06.117296 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-244fbc5b-096d-4df1-937f-72494824b3e9 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:06.280734 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-90159ce3-ec98-4013-83d2-cec640e8a630 tempest-VolumesNegativeTest-1241195036 tempest-VolumesNegativeTest-1241195036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624b59c47f79477f8eb4d433c99f4278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef03c640c58d4cf7af6394cb2ca33af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:21:06.292528 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-90159ce3-ec98-4013-83d2-cec640e8a630 tempest-VolumesNegativeTest-1241195036 tempest-VolumesNegativeTest-1241195036-project] 10.222.0.66 "GET /compute/v2.1/servers/185570a5-ac44-4263-bf37-09b34256de29" status: 200 len: 1314 microversion: 2.1 time: 0.252025 Nov 22 12:21:06.293539 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 186/357] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:21:06 2021] GET /compute/v2.1/servers/185570a5-ac44-4263-bf37-09b34256de29 => generated 1314 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:21:06.390862 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-6bbd3674-cdcc-48fc-a2f6-b2942131495d tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1620449562", "imageRef": "31affc49-b6f0-44da-af65-4c65d72458b9", "flavorRef": "452", "networks": [{"uuid": "bb1f7e53-c4b2-4051-a4a6-124cbdcb8410"}]}} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:21:06.546124 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-244fbc5b-096d-4df1-937f-72494824b3e9 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b581fa25045cea9585ae4e707585d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5319fd2dee9b4b47b98f59bca1572ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:21:06.567721 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-244fbc5b-096d-4df1-937f-72494824b3e9 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] 10.222.0.66 "GET /compute/v2.1/servers/d457eff7-4539-4ee1-8c94-c51cd4b5b2c1" status: 200 len: 1318 microversion: 2.1 time: 0.484159 Nov 22 12:21:06.568902 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 172/358] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:21:06 2021] GET /compute/v2.1/servers/d457eff7-4539-4ee1-8c94-c51cd4b5b2c1 => generated 1318 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:21:06.665976 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.network.neutron [None req-6bbd3674-cdcc-48fc-a2f6-b2942131495d tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] validate_networks() for [('bb1f7e53-c4b2-4051-a4a6-124cbdcb8410', None, None, None, None, None)] {{(pid=116272) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 22 12:21:06.738661 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-cfd2d03d-e237-4e4b-bcf1-dfcbc8a123d9 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:21:06.740548 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-cfd2d03d-e237-4e4b-bcf1-dfcbc8a123d9 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: 2306113c-8f98-42fd-8c0c-3dfac98fff21] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:06.748221 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-cfd2d03d-e237-4e4b-bcf1-dfcbc8a123d9 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:06.749014 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-cfd2d03d-e237-4e4b-bcf1-dfcbc8a123d9 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:06.750963 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-cfd2d03d-e237-4e4b-bcf1-dfcbc8a123d9 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:06.751503 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-cfd2d03d-e237-4e4b-bcf1-dfcbc8a123d9 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:06.847223 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-cfd2d03d-e237-4e4b-bcf1-dfcbc8a123d9 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "POST /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21/action" status: 200 len: 14 microversion: 2.1 time: 0.112899 Nov 22 12:21:06.848269 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 173/359] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Nov 22 12:21:06 2021] POST /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21/action => generated 14 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 22 12:21:06.856403 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-6279dcfa-5324-4d00-8500-22de39c2b2b8 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:21:06.857615 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-6279dcfa-5324-4d00-8500-22de39c2b2b8 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: c9f6d441-246f-479e-8e88-ea701c0f87ff] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:06.866075 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-6279dcfa-5324-4d00-8500-22de39c2b2b8 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:06.866686 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-6279dcfa-5324-4d00-8500-22de39c2b2b8 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:06.867656 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-6279dcfa-5324-4d00-8500-22de39c2b2b8 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:06.868164 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-6279dcfa-5324-4d00-8500-22de39c2b2b8 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:06.947447 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-6279dcfa-5324-4d00-8500-22de39c2b2b8 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "POST /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff/action" status: 200 len: 28631 microversion: 2.20 time: 0.097213 Nov 22 12:21:06.949468 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 174/360] 10.222.0.66 () {62 vars in 1318 bytes} [Mon Nov 22 12:21:06 2021] POST /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff/action => generated 28631 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 12:21:06.954492 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [req-8dd82467-2717-4d23-80e3-3d685f65fb4b req-34c8d08e-f64e-4884-9281-d9ebddaa66a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d457eff7-4539-4ee1-8c94-c51cd4b5b2c1", "tag": "e128f2b8-b093-4adf-809f-77c7db02499c"}]} {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:21:06.956179 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 12:21:06.956179 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: warnings.warn(msg) Nov 22 12:21:06.967583 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [req-8dd82467-2717-4d23-80e3-3d685f65fb4b req-34c8d08e-f64e-4884-9281-d9ebddaa66a1 service nova] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:06.968038 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [req-8dd82467-2717-4d23-80e3-3d685f65fb4b req-34c8d08e-f64e-4884-9281-d9ebddaa66a1 service nova] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:06.980216 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.compute.server_external_events [req-8dd82467-2717-4d23-80e3-3d685f65fb4b req-34c8d08e-f64e-4884-9281-d9ebddaa66a1 service nova] Creating event network-changed:e128f2b8-b093-4adf-809f-77c7db02499c for instance d457eff7-4539-4ee1-8c94-c51cd4b5b2c1 on hv-cinder-76845 Nov 22 12:21:06.986191 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [req-8dd82467-2717-4d23-80e3-3d685f65fb4b req-34c8d08e-f64e-4884-9281-d9ebddaa66a1 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035779 Nov 22 12:21:06.986880 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 175/361] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Nov 22 12:21:06 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 12:21:07.068943 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.virt.hardware [None req-6bbd3674-cdcc-48fc-a2f6-b2942131495d tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Flavor limits 0:0:0 {{(pid=116272) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 22 12:21:07.069364 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.virt.hardware [None req-6bbd3674-cdcc-48fc-a2f6-b2942131495d tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Image limits 0:0:0 {{(pid=116272) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 22 12:21:07.069835 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.virt.hardware [None req-6bbd3674-cdcc-48fc-a2f6-b2942131495d tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Flavor pref 0:0:0 {{(pid=116272) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 22 12:21:07.070236 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.virt.hardware [None req-6bbd3674-cdcc-48fc-a2f6-b2942131495d tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Image pref 0:0:0 {{(pid=116272) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 22 12:21:07.070641 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.virt.hardware [None req-6bbd3674-cdcc-48fc-a2f6-b2942131495d tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116272) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 22 12:21:07.080303 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-6bbd3674-cdcc-48fc-a2f6-b2942131495d tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:07.080771 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-6bbd3674-cdcc-48fc-a2f6-b2942131495d tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:07.081585 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-6bbd3674-cdcc-48fc-a2f6-b2942131495d tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:07.082019 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-6bbd3674-cdcc-48fc-a2f6-b2942131495d tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:07.099831 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-b229aec7-1a27-4052-b51e-b3cafcdbf5fe tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:21:07.100841 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.quota [None req-6bbd3674-cdcc-48fc-a2f6-b2942131495d tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Getting quotas for project ad46aac0327b4760bef46d579031abd2. Resources: {'ram', 'instances', 'cores'} {{(pid=116272) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 22 12:21:07.101118 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-b229aec7-1a27-4052-b51e-b3cafcdbf5fe tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] [instance: 302ab8ef-5565-4f9b-9b91-b405d550a90d] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:07.106013 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.quota [None req-6bbd3674-cdcc-48fc-a2f6-b2942131495d tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Getting quotas for user 8989f156c213442795edd8b9195bcbb3 and project ad46aac0327b4760bef46d579031abd2. Resources: {'ram', 'instances', 'cores'} {{(pid=116272) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 22 12:21:07.108235 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-b229aec7-1a27-4052-b51e-b3cafcdbf5fe tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:07.108848 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-b229aec7-1a27-4052-b51e-b3cafcdbf5fe tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:07.110018 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-b229aec7-1a27-4052-b51e-b3cafcdbf5fe tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:07.114350 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-b229aec7-1a27-4052-b51e-b3cafcdbf5fe tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:07.124403 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-6bbd3674-cdcc-48fc-a2f6-b2942131495d tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Going to run 1 instances... {{(pid=116272) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 22 12:21:07.126855 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-6bbd3674-cdcc-48fc-a2f6-b2942131495d tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] [instance: c30dcb83-017d-4428-9150-b68e8835ca64] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='31affc49-b6f0-44da-af65-4c65d72458b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116272) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 22 12:21:07.181556 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-6bbd3674-cdcc-48fc-a2f6-b2942131495d tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.796081 Nov 22 12:21:07.188365 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 187/362] 10.222.0.66 () {60 vars in 1146 bytes} [Mon Nov 22 12:21:06 2021] POST /compute/v2.1/servers => generated 380 bytes in 804 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 22 12:21:07.196330 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-2277906c-af91-4b65-bf15-314c83b84563 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:21:07.196977 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-2277906c-af91-4b65-bf15-314c83b84563 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] [instance: c30dcb83-017d-4428-9150-b68e8835ca64] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:07.281373 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-2277906c-af91-4b65-bf15-314c83b84563 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8989f156c213442795edd8b9195bcbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad46aac0327b4760bef46d579031abd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:21:07.284652 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-b229aec7-1a27-4052-b51e-b3cafcdbf5fe tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1efac6c215148ce8c3ecdce1e9a8742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d392a7d77f46fcb4faa017786796fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:21:07.292619 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-2277906c-af91-4b65-bf15-314c83b84563 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] 10.222.0.66 "GET /compute/v2.1/servers/c30dcb83-017d-4428-9150-b68e8835ca64" status: 200 len: 1214 microversion: 2.1 time: 0.102533 Nov 22 12:21:07.293160 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-b229aec7-1a27-4052-b51e-b3cafcdbf5fe tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] 10.222.0.66 "GET /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d" status: 200 len: 1521 microversion: 2.1 time: 0.199859 Nov 22 12:21:07.293286 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 188/363] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:21:07 2021] GET /compute/v2.1/servers/c30dcb83-017d-4428-9150-b68e8835ca64 => generated 1214 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:21:07.293722 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 176/364] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:21:07 2021] GET /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d => generated 1521 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:21:07.311311 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-e664e87b-87dd-49a1-a60c-c8349646b051 tempest-VolumesNegativeTest-1241195036 tempest-VolumesNegativeTest-1241195036-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:21:07.312171 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-e664e87b-87dd-49a1-a60c-c8349646b051 tempest-VolumesNegativeTest-1241195036 tempest-VolumesNegativeTest-1241195036-project] [instance: 185570a5-ac44-4263-bf37-09b34256de29] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:07.319317 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-e664e87b-87dd-49a1-a60c-c8349646b051 tempest-VolumesNegativeTest-1241195036 tempest-VolumesNegativeTest-1241195036-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:07.320030 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-e664e87b-87dd-49a1-a60c-c8349646b051 tempest-VolumesNegativeTest-1241195036 tempest-VolumesNegativeTest-1241195036-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:07.320967 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-e664e87b-87dd-49a1-a60c-c8349646b051 tempest-VolumesNegativeTest-1241195036 tempest-VolumesNegativeTest-1241195036-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:07.321724 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-e664e87b-87dd-49a1-a60c-c8349646b051 tempest-VolumesNegativeTest-1241195036 tempest-VolumesNegativeTest-1241195036-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:07.494820 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-e664e87b-87dd-49a1-a60c-c8349646b051 tempest-VolumesNegativeTest-1241195036 tempest-VolumesNegativeTest-1241195036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624b59c47f79477f8eb4d433c99f4278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef03c640c58d4cf7af6394cb2ca33af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:21:07.505065 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-e664e87b-87dd-49a1-a60c-c8349646b051 tempest-VolumesNegativeTest-1241195036 tempest-VolumesNegativeTest-1241195036-project] 10.222.0.66 "GET /compute/v2.1/servers/185570a5-ac44-4263-bf37-09b34256de29" status: 200 len: 1314 microversion: 2.1 time: 0.197527 Nov 22 12:21:07.506715 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 189/365] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:21:07 2021] GET /compute/v2.1/servers/185570a5-ac44-4263-bf37-09b34256de29 => generated 1314 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:21:07.590062 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-4ab160a0-ad80-49d7-b26c-8fae6e3d72b9 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:21:07.590689 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-4ab160a0-ad80-49d7-b26c-8fae6e3d72b9 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] [instance: d457eff7-4539-4ee1-8c94-c51cd4b5b2c1] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:07.597382 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-4ab160a0-ad80-49d7-b26c-8fae6e3d72b9 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:07.597788 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-4ab160a0-ad80-49d7-b26c-8fae6e3d72b9 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:07.598588 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-4ab160a0-ad80-49d7-b26c-8fae6e3d72b9 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:07.599273 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-4ab160a0-ad80-49d7-b26c-8fae6e3d72b9 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:07.799213 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-4ab160a0-ad80-49d7-b26c-8fae6e3d72b9 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b581fa25045cea9585ae4e707585d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5319fd2dee9b4b47b98f59bca1572ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:21:07.817783 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-4ab160a0-ad80-49d7-b26c-8fae6e3d72b9 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] 10.222.0.66 "GET /compute/v2.1/servers/d457eff7-4539-4ee1-8c94-c51cd4b5b2c1" status: 200 len: 1318 microversion: 2.1 time: 0.232515 Nov 22 12:21:07.818565 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 177/366] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:21:07 2021] GET /compute/v2.1/servers/d457eff7-4539-4ee1-8c94-c51cd4b5b2c1 => generated 1318 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:21:07.858733 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-c5c2df63-a155-4516-9f96-1338debc73be tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:21:07.860924 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-c5c2df63-a155-4516-9f96-1338debc73be tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: 2306113c-8f98-42fd-8c0c-3dfac98fff21] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:07.867721 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-c5c2df63-a155-4516-9f96-1338debc73be tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:07.868373 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-c5c2df63-a155-4516-9f96-1338debc73be tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:07.870328 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-c5c2df63-a155-4516-9f96-1338debc73be tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:07.870921 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-c5c2df63-a155-4516-9f96-1338debc73be tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:07.960525 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-c9446bac-8d6e-489d-9379-86bbc1a500cf tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:21:07.961749 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-c9446bac-8d6e-489d-9379-86bbc1a500cf tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: c9f6d441-246f-479e-8e88-ea701c0f87ff] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:07.967981 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-c9446bac-8d6e-489d-9379-86bbc1a500cf tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:07.968532 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-c9446bac-8d6e-489d-9379-86bbc1a500cf tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:07.969328 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-c9446bac-8d6e-489d-9379-86bbc1a500cf tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:07.970313 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-c9446bac-8d6e-489d-9379-86bbc1a500cf tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:07.978646 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-c5c2df63-a155-4516-9f96-1338debc73be tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "POST /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21/action" status: 200 len: 14 microversion: 2.1 time: 0.123527 Nov 22 12:21:07.979494 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 190/367] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Nov 22 12:21:07 2021] POST /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21/action => generated 14 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 22 12:21:08.067086 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-c9446bac-8d6e-489d-9379-86bbc1a500cf tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "POST /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff/action" status: 200 len: 28631 microversion: 2.20 time: 0.110362 Nov 22 12:21:08.067815 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 178/368] 10.222.0.66 () {62 vars in 1318 bytes} [Mon Nov 22 12:21:07 2021] POST /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff/action => generated 28631 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 22 12:21:08.311035 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-d4b51fc7-cb79-4cc5-ad11-117e03a0fe17 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:21:08.311573 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-c5248699-9689-4792-a6e2-44bb45808d72 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:21:08.311777 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-d4b51fc7-cb79-4cc5-ad11-117e03a0fe17 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] [instance: 302ab8ef-5565-4f9b-9b91-b405d550a90d] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:08.312258 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-c5248699-9689-4792-a6e2-44bb45808d72 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] [instance: c30dcb83-017d-4428-9150-b68e8835ca64] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:08.319064 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-d4b51fc7-cb79-4cc5-ad11-117e03a0fe17 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:08.319579 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-d4b51fc7-cb79-4cc5-ad11-117e03a0fe17 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:08.320125 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-c5248699-9689-4792-a6e2-44bb45808d72 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:08.320444 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-d4b51fc7-cb79-4cc5-ad11-117e03a0fe17 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:08.320549 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-c5248699-9689-4792-a6e2-44bb45808d72 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:08.320883 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-d4b51fc7-cb79-4cc5-ad11-117e03a0fe17 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:08.321363 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-c5248699-9689-4792-a6e2-44bb45808d72 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:08.321804 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-c5248699-9689-4792-a6e2-44bb45808d72 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:08.406369 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-c5248699-9689-4792-a6e2-44bb45808d72 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8989f156c213442795edd8b9195bcbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad46aac0327b4760bef46d579031abd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:21:08.418723 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-c5248699-9689-4792-a6e2-44bb45808d72 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] 10.222.0.66 "GET /compute/v2.1/servers/c30dcb83-017d-4428-9150-b68e8835ca64" status: 200 len: 1266 microversion: 2.1 time: 0.111525 Nov 22 12:21:08.420015 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 191/369] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:21:08 2021] GET /compute/v2.1/servers/c30dcb83-017d-4428-9150-b68e8835ca64 => generated 1266 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:21:08.496832 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-d4b51fc7-cb79-4cc5-ad11-117e03a0fe17 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1efac6c215148ce8c3ecdce1e9a8742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d392a7d77f46fcb4faa017786796fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:21:08.511521 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-d4b51fc7-cb79-4cc5-ad11-117e03a0fe17 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] 10.222.0.66 "GET /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d" status: 200 len: 1521 microversion: 2.1 time: 0.204441 Nov 22 12:21:08.512548 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 179/370] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:21:08 2021] GET /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d => generated 1521 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:21:08.524684 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-26384d1e-82e3-4c39-99d2-909c70f9c7b7 tempest-VolumesNegativeTest-1241195036 tempest-VolumesNegativeTest-1241195036-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:21:08.525588 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-26384d1e-82e3-4c39-99d2-909c70f9c7b7 tempest-VolumesNegativeTest-1241195036 tempest-VolumesNegativeTest-1241195036-project] [instance: 185570a5-ac44-4263-bf37-09b34256de29] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:08.531770 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-26384d1e-82e3-4c39-99d2-909c70f9c7b7 tempest-VolumesNegativeTest-1241195036 tempest-VolumesNegativeTest-1241195036-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:08.532466 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-26384d1e-82e3-4c39-99d2-909c70f9c7b7 tempest-VolumesNegativeTest-1241195036 tempest-VolumesNegativeTest-1241195036-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:08.533514 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-26384d1e-82e3-4c39-99d2-909c70f9c7b7 tempest-VolumesNegativeTest-1241195036 tempest-VolumesNegativeTest-1241195036-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:08.534131 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-26384d1e-82e3-4c39-99d2-909c70f9c7b7 tempest-VolumesNegativeTest-1241195036 tempest-VolumesNegativeTest-1241195036-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:08.682439 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-26384d1e-82e3-4c39-99d2-909c70f9c7b7 tempest-VolumesNegativeTest-1241195036 tempest-VolumesNegativeTest-1241195036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624b59c47f79477f8eb4d433c99f4278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef03c640c58d4cf7af6394cb2ca33af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:21:08.690510 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-26384d1e-82e3-4c39-99d2-909c70f9c7b7 tempest-VolumesNegativeTest-1241195036 tempest-VolumesNegativeTest-1241195036-project] 10.222.0.66 "GET /compute/v2.1/servers/185570a5-ac44-4263-bf37-09b34256de29" status: 200 len: 1314 microversion: 2.1 time: 0.169929 Nov 22 12:21:08.691114 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 192/371] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:21:08 2021] GET /compute/v2.1/servers/185570a5-ac44-4263-bf37-09b34256de29 => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:21:08.836565 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-a9735955-a79d-4424-b917-b8e80178b162 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:21:08.837183 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-a9735955-a79d-4424-b917-b8e80178b162 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] [instance: d457eff7-4539-4ee1-8c94-c51cd4b5b2c1] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:08.845217 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-a9735955-a79d-4424-b917-b8e80178b162 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:08.845661 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-a9735955-a79d-4424-b917-b8e80178b162 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:08.846479 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-a9735955-a79d-4424-b917-b8e80178b162 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:08.846909 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-a9735955-a79d-4424-b917-b8e80178b162 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:08.989716 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-92bf405b-ada9-4139-b4bb-9e8e31d2915a tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:21:08.991515 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-92bf405b-ada9-4139-b4bb-9e8e31d2915a tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: 2306113c-8f98-42fd-8c0c-3dfac98fff21] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:08.998434 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-a9735955-a79d-4424-b917-b8e80178b162 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b581fa25045cea9585ae4e707585d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5319fd2dee9b4b47b98f59bca1572ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:21:09.006971 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-92bf405b-ada9-4139-b4bb-9e8e31d2915a tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:09.007440 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-92bf405b-ada9-4139-b4bb-9e8e31d2915a tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:09.008246 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-92bf405b-ada9-4139-b4bb-9e8e31d2915a tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:09.008673 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-92bf405b-ada9-4139-b4bb-9e8e31d2915a tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:09.010014 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-a9735955-a79d-4424-b917-b8e80178b162 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] 10.222.0.66 "GET /compute/v2.1/servers/d457eff7-4539-4ee1-8c94-c51cd4b5b2c1" status: 200 len: 1318 microversion: 2.1 time: 0.177549 Nov 22 12:21:09.011118 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 180/372] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:21:08 2021] GET /compute/v2.1/servers/d457eff7-4539-4ee1-8c94-c51cd4b5b2c1 => generated 1318 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:21:09.080548 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-2e6b548c-b773-4f32-af5a-10b119f50a75 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:21:09.082025 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-2e6b548c-b773-4f32-af5a-10b119f50a75 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: c9f6d441-246f-479e-8e88-ea701c0f87ff] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:09.093255 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-2e6b548c-b773-4f32-af5a-10b119f50a75 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:09.093971 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-2e6b548c-b773-4f32-af5a-10b119f50a75 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:09.095160 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-2e6b548c-b773-4f32-af5a-10b119f50a75 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:09.100488 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-2e6b548c-b773-4f32-af5a-10b119f50a75 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:09.133427 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-92bf405b-ada9-4139-b4bb-9e8e31d2915a tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "POST /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21/action" status: 200 len: 14 microversion: 2.1 time: 0.146909 Nov 22 12:21:09.137510 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 193/373] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Nov 22 12:21:08 2021] POST /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21/action => generated 14 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 22 12:21:09.203730 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-2e6b548c-b773-4f32-af5a-10b119f50a75 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "POST /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff/action" status: 200 len: 28631 microversion: 2.20 time: 0.127333 Nov 22 12:21:09.204421 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 181/374] 10.222.0.66 () {62 vars in 1318 bytes} [Mon Nov 22 12:21:09 2021] POST /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff/action => generated 28631 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 22 12:21:09.438462 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-be889c0c-b1af-453b-8016-f7a29331d22b tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:21:09.439534 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-be889c0c-b1af-453b-8016-f7a29331d22b tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] [instance: c30dcb83-017d-4428-9150-b68e8835ca64] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:09.447272 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-be889c0c-b1af-453b-8016-f7a29331d22b tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:09.448170 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-be889c0c-b1af-453b-8016-f7a29331d22b tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:09.449142 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-be889c0c-b1af-453b-8016-f7a29331d22b tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:09.449822 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-be889c0c-b1af-453b-8016-f7a29331d22b tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:09.541231 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-8c120aab-dc4c-47f9-a9d5-cae4e21266c4 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:21:09.542841 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-8c120aab-dc4c-47f9-a9d5-cae4e21266c4 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] [instance: 302ab8ef-5565-4f9b-9b91-b405d550a90d] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:09.550947 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-8c120aab-dc4c-47f9-a9d5-cae4e21266c4 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:09.551448 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-8c120aab-dc4c-47f9-a9d5-cae4e21266c4 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:09.552390 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-8c120aab-dc4c-47f9-a9d5-cae4e21266c4 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:09.552831 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-8c120aab-dc4c-47f9-a9d5-cae4e21266c4 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:09.874834 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-be889c0c-b1af-453b-8016-f7a29331d22b tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8989f156c213442795edd8b9195bcbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad46aac0327b4760bef46d579031abd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:21:09.883902 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-be889c0c-b1af-453b-8016-f7a29331d22b tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] 10.222.0.66 "GET /compute/v2.1/servers/c30dcb83-017d-4428-9150-b68e8835ca64" status: 200 len: 1314 microversion: 2.1 time: 0.450071 Nov 22 12:21:09.884785 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 194/375] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:21:09 2021] GET /compute/v2.1/servers/c30dcb83-017d-4428-9150-b68e8835ca64 => generated 1314 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 12:21:09.889525 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-f5aed0c0-f1d0-44d8-9e3f-e3fb5de968ae tempest-VolumesNegativeTest-1241195036 tempest-VolumesNegativeTest-1241195036-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:21:09.889997 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-f5aed0c0-f1d0-44d8-9e3f-e3fb5de968ae tempest-VolumesNegativeTest-1241195036 tempest-VolumesNegativeTest-1241195036-project] [instance: 185570a5-ac44-4263-bf37-09b34256de29] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:09.896401 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-f5aed0c0-f1d0-44d8-9e3f-e3fb5de968ae tempest-VolumesNegativeTest-1241195036 tempest-VolumesNegativeTest-1241195036-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:09.897197 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-f5aed0c0-f1d0-44d8-9e3f-e3fb5de968ae tempest-VolumesNegativeTest-1241195036 tempest-VolumesNegativeTest-1241195036-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:09.897844 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-f5aed0c0-f1d0-44d8-9e3f-e3fb5de968ae tempest-VolumesNegativeTest-1241195036 tempest-VolumesNegativeTest-1241195036-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:09.898577 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-f5aed0c0-f1d0-44d8-9e3f-e3fb5de968ae tempest-VolumesNegativeTest-1241195036 tempest-VolumesNegativeTest-1241195036-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:09.974342 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-8c120aab-dc4c-47f9-a9d5-cae4e21266c4 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1efac6c215148ce8c3ecdce1e9a8742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d392a7d77f46fcb4faa017786796fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:21:09.994786 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-8c120aab-dc4c-47f9-a9d5-cae4e21266c4 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] 10.222.0.66 "GET /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d" status: 200 len: 1521 microversion: 2.1 time: 0.467710 Nov 22 12:21:10.005976 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 182/376] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:21:09 2021] GET /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d => generated 1521 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:21:10.027422 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-6bdceacb-8ff0-4835-996a-0790d8110b00 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:21:10.028925 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-6bdceacb-8ff0-4835-996a-0790d8110b00 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] [instance: d457eff7-4539-4ee1-8c94-c51cd4b5b2c1] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:10.045151 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-6bdceacb-8ff0-4835-996a-0790d8110b00 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:10.046335 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-6bdceacb-8ff0-4835-996a-0790d8110b00 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:10.047781 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-6bdceacb-8ff0-4835-996a-0790d8110b00 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:10.048378 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-6bdceacb-8ff0-4835-996a-0790d8110b00 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:10.076552 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-f5aed0c0-f1d0-44d8-9e3f-e3fb5de968ae tempest-VolumesNegativeTest-1241195036 tempest-VolumesNegativeTest-1241195036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624b59c47f79477f8eb4d433c99f4278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef03c640c58d4cf7af6394cb2ca33af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:21:10.085560 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-f5aed0c0-f1d0-44d8-9e3f-e3fb5de968ae tempest-VolumesNegativeTest-1241195036 tempest-VolumesNegativeTest-1241195036-project] 10.222.0.66 "GET /compute/v2.1/servers/185570a5-ac44-4263-bf37-09b34256de29" status: 200 len: 1314 microversion: 2.1 time: 0.199683 Nov 22 12:21:10.086834 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 195/377] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:21:09 2021] GET /compute/v2.1/servers/185570a5-ac44-4263-bf37-09b34256de29 => generated 1314 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:21:10.145579 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-d0cb4843-99d7-4c76-b186-923f690f985f tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:21:10.146984 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-d0cb4843-99d7-4c76-b186-923f690f985f tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: 2306113c-8f98-42fd-8c0c-3dfac98fff21] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:10.154504 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-d0cb4843-99d7-4c76-b186-923f690f985f tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:10.155140 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-d0cb4843-99d7-4c76-b186-923f690f985f tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:10.156387 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-d0cb4843-99d7-4c76-b186-923f690f985f tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:10.156713 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-d0cb4843-99d7-4c76-b186-923f690f985f tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:10.227746 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-6bdceacb-8ff0-4835-996a-0790d8110b00 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b581fa25045cea9585ae4e707585d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5319fd2dee9b4b47b98f59bca1572ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:21:10.237227 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-6bdceacb-8ff0-4835-996a-0790d8110b00 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] 10.222.0.66 "GET /compute/v2.1/servers/d457eff7-4539-4ee1-8c94-c51cd4b5b2c1" status: 200 len: 1318 microversion: 2.1 time: 0.214082 Nov 22 12:21:10.237939 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 183/378] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:21:10 2021] GET /compute/v2.1/servers/d457eff7-4539-4ee1-8c94-c51cd4b5b2c1 => generated 1318 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 12:21:10.246848 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-9defeb55-7a95-486e-bd2a-8401617620c5 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:21:10.246848 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-9defeb55-7a95-486e-bd2a-8401617620c5 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: c9f6d441-246f-479e-8e88-ea701c0f87ff] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:10.250381 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-9defeb55-7a95-486e-bd2a-8401617620c5 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:10.251444 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-9defeb55-7a95-486e-bd2a-8401617620c5 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:10.252514 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-9defeb55-7a95-486e-bd2a-8401617620c5 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:10.254157 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-9defeb55-7a95-486e-bd2a-8401617620c5 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:10.329774 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-d0cb4843-99d7-4c76-b186-923f690f985f tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "POST /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21/action" status: 200 len: 14 microversion: 2.1 time: 0.188051 Nov 22 12:21:10.334396 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 196/379] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Nov 22 12:21:10 2021] POST /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21/action => generated 14 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 22 12:21:10.336733 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [req-41ecc2d6-e04b-4259-a806-36ddc750b708 req-5c75118d-06b5-4610-b33a-0f91dfeba7da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c30dcb83-017d-4428-9150-b68e8835ca64", "tag": "0bbd7299-c83f-4a3c-bdea-4930e3bb6de3"}]} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:21:10.338450 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 12:21:10.338450 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: warnings.warn(msg) Nov 22 12:21:10.347915 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [req-41ecc2d6-e04b-4259-a806-36ddc750b708 req-5c75118d-06b5-4610-b33a-0f91dfeba7da service nova] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:10.348476 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [req-41ecc2d6-e04b-4259-a806-36ddc750b708 req-5c75118d-06b5-4610-b33a-0f91dfeba7da service nova] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:10.371610 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.compute.server_external_events [req-41ecc2d6-e04b-4259-a806-36ddc750b708 req-5c75118d-06b5-4610-b33a-0f91dfeba7da service nova] Creating event network-changed:0bbd7299-c83f-4a3c-bdea-4930e3bb6de3 for instance c30dcb83-017d-4428-9150-b68e8835ca64 on hv-cinder-76845 Nov 22 12:21:10.376643 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [req-41ecc2d6-e04b-4259-a806-36ddc750b708 req-5c75118d-06b5-4610-b33a-0f91dfeba7da service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043531 Nov 22 12:21:10.377242 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 197/380] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Nov 22 12:21:10 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 12:21:10.393192 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-9defeb55-7a95-486e-bd2a-8401617620c5 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "POST /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff/action" status: 200 len: 28748 microversion: 2.20 time: 0.153938 Nov 22 12:21:10.393860 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 184/381] 10.222.0.66 () {62 vars in 1318 bytes} [Mon Nov 22 12:21:10 2021] POST /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff/action => generated 28748 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 12:21:10.901935 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-296aac98-fb54-4f2b-bb64-0c73c8521a7a tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:21:10.902660 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-296aac98-fb54-4f2b-bb64-0c73c8521a7a tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] [instance: c30dcb83-017d-4428-9150-b68e8835ca64] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:10.910169 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-296aac98-fb54-4f2b-bb64-0c73c8521a7a tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:10.910602 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-296aac98-fb54-4f2b-bb64-0c73c8521a7a tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:10.911435 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-296aac98-fb54-4f2b-bb64-0c73c8521a7a tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:10.911890 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-296aac98-fb54-4f2b-bb64-0c73c8521a7a tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:11.013121 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-a685acee-dba4-4163-9f3b-45a2c37d9859 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:21:11.013838 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-a685acee-dba4-4163-9f3b-45a2c37d9859 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] [instance: 302ab8ef-5565-4f9b-9b91-b405d550a90d] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:11.021739 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-a685acee-dba4-4163-9f3b-45a2c37d9859 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:11.022198 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-a685acee-dba4-4163-9f3b-45a2c37d9859 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:11.023081 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-a685acee-dba4-4163-9f3b-45a2c37d9859 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:11.023755 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-a685acee-dba4-4163-9f3b-45a2c37d9859 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:11.063613 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-296aac98-fb54-4f2b-bb64-0c73c8521a7a tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8989f156c213442795edd8b9195bcbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad46aac0327b4760bef46d579031abd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:21:11.073132 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-296aac98-fb54-4f2b-bb64-0c73c8521a7a tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] 10.222.0.66 "GET /compute/v2.1/servers/c30dcb83-017d-4428-9150-b68e8835ca64" status: 200 len: 1314 microversion: 2.1 time: 0.175029 Nov 22 12:21:11.074241 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 198/382] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:21:10 2021] GET /compute/v2.1/servers/c30dcb83-017d-4428-9150-b68e8835ca64 => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:21:11.104474 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-2a1a5047-8047-41a3-9641-1669d104e298 tempest-VolumesNegativeTest-1241195036 tempest-VolumesNegativeTest-1241195036-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:21:11.105065 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-2a1a5047-8047-41a3-9641-1669d104e298 tempest-VolumesNegativeTest-1241195036 tempest-VolumesNegativeTest-1241195036-project] [instance: 185570a5-ac44-4263-bf37-09b34256de29] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:11.113577 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-2a1a5047-8047-41a3-9641-1669d104e298 tempest-VolumesNegativeTest-1241195036 tempest-VolumesNegativeTest-1241195036-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:11.119271 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-2a1a5047-8047-41a3-9641-1669d104e298 tempest-VolumesNegativeTest-1241195036 tempest-VolumesNegativeTest-1241195036-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:11.120340 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-2a1a5047-8047-41a3-9641-1669d104e298 tempest-VolumesNegativeTest-1241195036 tempest-VolumesNegativeTest-1241195036-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:11.120789 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-2a1a5047-8047-41a3-9641-1669d104e298 tempest-VolumesNegativeTest-1241195036 tempest-VolumesNegativeTest-1241195036-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:11.197883 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-a685acee-dba4-4163-9f3b-45a2c37d9859 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1efac6c215148ce8c3ecdce1e9a8742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d392a7d77f46fcb4faa017786796fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:21:11.208235 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-a685acee-dba4-4163-9f3b-45a2c37d9859 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] 10.222.0.66 "GET /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d" status: 200 len: 1521 microversion: 2.1 time: 0.199104 Nov 22 12:21:11.209432 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 185/383] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:21:11 2021] GET /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d => generated 1521 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:21:11.254264 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-e68710d4-456e-4ebd-bc17-b97d21a3ad17 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:21:11.255674 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-e68710d4-456e-4ebd-bc17-b97d21a3ad17 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] [instance: d457eff7-4539-4ee1-8c94-c51cd4b5b2c1] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:11.261839 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-e68710d4-456e-4ebd-bc17-b97d21a3ad17 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:11.262517 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-e68710d4-456e-4ebd-bc17-b97d21a3ad17 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:11.265204 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-e68710d4-456e-4ebd-bc17-b97d21a3ad17 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:11.265204 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-e68710d4-456e-4ebd-bc17-b97d21a3ad17 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:11.302696 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-2a1a5047-8047-41a3-9641-1669d104e298 tempest-VolumesNegativeTest-1241195036 tempest-VolumesNegativeTest-1241195036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624b59c47f79477f8eb4d433c99f4278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef03c640c58d4cf7af6394cb2ca33af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:21:11.312003 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-2a1a5047-8047-41a3-9641-1669d104e298 tempest-VolumesNegativeTest-1241195036 tempest-VolumesNegativeTest-1241195036-project] 10.222.0.66 "GET /compute/v2.1/servers/185570a5-ac44-4263-bf37-09b34256de29" status: 200 len: 1314 microversion: 2.1 time: 0.212058 Nov 22 12:21:11.313300 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 199/384] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:21:11 2021] GET /compute/v2.1/servers/185570a5-ac44-4263-bf37-09b34256de29 => generated 1314 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:21:11.342029 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-b64ccfb2-29ce-4acb-a17f-28f5fc5cfcf3 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:21:11.343372 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-b64ccfb2-29ce-4acb-a17f-28f5fc5cfcf3 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: 2306113c-8f98-42fd-8c0c-3dfac98fff21] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:11.354547 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-b64ccfb2-29ce-4acb-a17f-28f5fc5cfcf3 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:11.355006 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-b64ccfb2-29ce-4acb-a17f-28f5fc5cfcf3 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:11.355838 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-b64ccfb2-29ce-4acb-a17f-28f5fc5cfcf3 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:11.356442 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-b64ccfb2-29ce-4acb-a17f-28f5fc5cfcf3 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:11.472377 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-e68710d4-456e-4ebd-bc17-b97d21a3ad17 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b581fa25045cea9585ae4e707585d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5319fd2dee9b4b47b98f59bca1572ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:21:11.480427 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-e68710d4-456e-4ebd-bc17-b97d21a3ad17 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] 10.222.0.66 "GET /compute/v2.1/servers/d457eff7-4539-4ee1-8c94-c51cd4b5b2c1" status: 200 len: 1318 microversion: 2.1 time: 0.230163 Nov 22 12:21:11.481002 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 186/385] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:21:11 2021] GET /compute/v2.1/servers/d457eff7-4539-4ee1-8c94-c51cd4b5b2c1 => generated 1318 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:21:11.495398 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-9190a08e-36bc-4747-a6fd-83c28442f41a tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:21:11.496657 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-9190a08e-36bc-4747-a6fd-83c28442f41a tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: c9f6d441-246f-479e-8e88-ea701c0f87ff] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:11.499207 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-b64ccfb2-29ce-4acb-a17f-28f5fc5cfcf3 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "POST /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21/action" status: 200 len: 14 microversion: 2.1 time: 0.160487 Nov 22 12:21:11.503368 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 200/386] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Nov 22 12:21:11 2021] POST /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21/action => generated 14 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 22 12:21:11.504025 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-9190a08e-36bc-4747-a6fd-83c28442f41a tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:11.504904 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-9190a08e-36bc-4747-a6fd-83c28442f41a tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:11.505975 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-9190a08e-36bc-4747-a6fd-83c28442f41a tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:11.506496 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-9190a08e-36bc-4747-a6fd-83c28442f41a tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:11.554266 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [req-136c7658-3c48-41ed-8a6c-0465f5805cdb req-e748989f-d049-4020-838f-e3e3e1e36015 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "185570a5-ac44-4263-bf37-09b34256de29", "name": "network-vif-plugged", "status": "completed", "tag": "4064eb13-0c50-40e5-a2ea-9dd0aabf8848"}]} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:21:11.555885 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 12:21:11.555885 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: warnings.warn(msg) Nov 22 12:21:11.566246 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [req-136c7658-3c48-41ed-8a6c-0465f5805cdb req-e748989f-d049-4020-838f-e3e3e1e36015 service nova] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:11.566789 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [req-136c7658-3c48-41ed-8a6c-0465f5805cdb req-e748989f-d049-4020-838f-e3e3e1e36015 service nova] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:11.581055 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.compute.server_external_events [req-136c7658-3c48-41ed-8a6c-0465f5805cdb req-e748989f-d049-4020-838f-e3e3e1e36015 service nova] Creating event network-vif-plugged:4064eb13-0c50-40e5-a2ea-9dd0aabf8848 for instance 185570a5-ac44-4263-bf37-09b34256de29 on hv-cinder-76845 Nov 22 12:21:11.586943 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [req-136c7658-3c48-41ed-8a6c-0465f5805cdb req-e748989f-d049-4020-838f-e3e3e1e36015 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038965 Nov 22 12:21:11.587436 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 201/387] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Nov 22 12:21:11 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 22 12:21:11.682256 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-9190a08e-36bc-4747-a6fd-83c28442f41a tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "POST /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff/action" status: 200 len: 29256 microversion: 2.20 time: 0.190321 Nov 22 12:21:11.683079 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 187/388] 10.222.0.66 () {62 vars in 1318 bytes} [Mon Nov 22 12:21:11 2021] POST /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff/action => generated 29256 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 12:21:12.092767 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-29b14baf-ea26-426f-ad63-2a6858da8af8 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:21:12.093363 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-29b14baf-ea26-426f-ad63-2a6858da8af8 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] [instance: c30dcb83-017d-4428-9150-b68e8835ca64] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:12.100646 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-29b14baf-ea26-426f-ad63-2a6858da8af8 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:12.101094 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-29b14baf-ea26-426f-ad63-2a6858da8af8 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:12.101894 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-29b14baf-ea26-426f-ad63-2a6858da8af8 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:12.102317 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-29b14baf-ea26-426f-ad63-2a6858da8af8 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:12.226088 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-fb3d9531-b493-4bf7-aa6a-ec775fa0c656 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:21:12.226775 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-fb3d9531-b493-4bf7-aa6a-ec775fa0c656 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] [instance: 302ab8ef-5565-4f9b-9b91-b405d550a90d] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:12.235560 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-fb3d9531-b493-4bf7-aa6a-ec775fa0c656 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:12.235989 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-fb3d9531-b493-4bf7-aa6a-ec775fa0c656 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:12.236783 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-fb3d9531-b493-4bf7-aa6a-ec775fa0c656 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:12.237382 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-fb3d9531-b493-4bf7-aa6a-ec775fa0c656 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:12.255203 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-29b14baf-ea26-426f-ad63-2a6858da8af8 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8989f156c213442795edd8b9195bcbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad46aac0327b4760bef46d579031abd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:21:12.263768 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-29b14baf-ea26-426f-ad63-2a6858da8af8 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] 10.222.0.66 "GET /compute/v2.1/servers/c30dcb83-017d-4428-9150-b68e8835ca64" status: 200 len: 1314 microversion: 2.1 time: 0.175206 Nov 22 12:21:12.264400 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 202/389] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:21:12 2021] GET /compute/v2.1/servers/c30dcb83-017d-4428-9150-b68e8835ca64 => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:21:12.331267 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-4deefbe7-644d-49a1-ab6e-561dcdcc80ca tempest-VolumesNegativeTest-1241195036 tempest-VolumesNegativeTest-1241195036-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:21:12.331267 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-4deefbe7-644d-49a1-ab6e-561dcdcc80ca tempest-VolumesNegativeTest-1241195036 tempest-VolumesNegativeTest-1241195036-project] [instance: 185570a5-ac44-4263-bf37-09b34256de29] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:12.337441 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-4deefbe7-644d-49a1-ab6e-561dcdcc80ca tempest-VolumesNegativeTest-1241195036 tempest-VolumesNegativeTest-1241195036-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:12.337985 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-4deefbe7-644d-49a1-ab6e-561dcdcc80ca tempest-VolumesNegativeTest-1241195036 tempest-VolumesNegativeTest-1241195036-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:12.340479 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-4deefbe7-644d-49a1-ab6e-561dcdcc80ca tempest-VolumesNegativeTest-1241195036 tempest-VolumesNegativeTest-1241195036-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:12.340479 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-4deefbe7-644d-49a1-ab6e-561dcdcc80ca tempest-VolumesNegativeTest-1241195036 tempest-VolumesNegativeTest-1241195036-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:12.409715 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-fb3d9531-b493-4bf7-aa6a-ec775fa0c656 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1efac6c215148ce8c3ecdce1e9a8742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d392a7d77f46fcb4faa017786796fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:21:12.417893 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-fb3d9531-b493-4bf7-aa6a-ec775fa0c656 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] 10.222.0.66 "GET /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d" status: 200 len: 1521 microversion: 2.1 time: 0.195813 Nov 22 12:21:12.418463 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 188/390] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:21:12 2021] GET /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d => generated 1521 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:21:12.482589 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-4deefbe7-644d-49a1-ab6e-561dcdcc80ca tempest-VolumesNegativeTest-1241195036 tempest-VolumesNegativeTest-1241195036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624b59c47f79477f8eb4d433c99f4278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef03c640c58d4cf7af6394cb2ca33af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:21:12.491295 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-4deefbe7-644d-49a1-ab6e-561dcdcc80ca tempest-VolumesNegativeTest-1241195036 tempest-VolumesNegativeTest-1241195036-project] 10.222.0.66 "GET /compute/v2.1/servers/185570a5-ac44-4263-bf37-09b34256de29" status: 200 len: 1314 microversion: 2.1 time: 0.165048 Nov 22 12:21:12.492132 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 203/391] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:21:12 2021] GET /compute/v2.1/servers/185570a5-ac44-4263-bf37-09b34256de29 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:21:12.497717 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-bcd2b540-a896-4df0-8719-be41eb1fcfef tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:21:12.498334 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-bcd2b540-a896-4df0-8719-be41eb1fcfef tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] [instance: d457eff7-4539-4ee1-8c94-c51cd4b5b2c1] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:12.506910 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-bcd2b540-a896-4df0-8719-be41eb1fcfef tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:12.507404 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-bcd2b540-a896-4df0-8719-be41eb1fcfef tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:12.508340 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-bcd2b540-a896-4df0-8719-be41eb1fcfef tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:12.508930 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-bcd2b540-a896-4df0-8719-be41eb1fcfef tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:12.516903 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-ee831454-6a37-495b-9643-0f7db69879ae tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:21:12.517858 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-ee831454-6a37-495b-9643-0f7db69879ae tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: 2306113c-8f98-42fd-8c0c-3dfac98fff21] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:12.524040 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-ee831454-6a37-495b-9643-0f7db69879ae tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:12.524477 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-ee831454-6a37-495b-9643-0f7db69879ae tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:12.525298 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-ee831454-6a37-495b-9643-0f7db69879ae tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:12.525717 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-ee831454-6a37-495b-9643-0f7db69879ae tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:12.620138 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-ee831454-6a37-495b-9643-0f7db69879ae tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "POST /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21/action" status: 200 len: 14 microversion: 2.1 time: 0.107847 Nov 22 12:21:12.621143 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 204/392] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Nov 22 12:21:12 2021] POST /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21/action => generated 14 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 22 12:21:12.665930 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-bcd2b540-a896-4df0-8719-be41eb1fcfef tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b581fa25045cea9585ae4e707585d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5319fd2dee9b4b47b98f59bca1572ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:21:12.675610 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-bcd2b540-a896-4df0-8719-be41eb1fcfef tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] 10.222.0.66 "GET /compute/v2.1/servers/d457eff7-4539-4ee1-8c94-c51cd4b5b2c1" status: 200 len: 1318 microversion: 2.1 time: 0.181284 Nov 22 12:21:12.676285 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 189/393] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:21:12 2021] GET /compute/v2.1/servers/d457eff7-4539-4ee1-8c94-c51cd4b5b2c1 => generated 1318 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:21:12.695447 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-2d22522a-2f6b-4256-978a-0051dc15cd86 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:21:12.696551 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-2d22522a-2f6b-4256-978a-0051dc15cd86 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: c9f6d441-246f-479e-8e88-ea701c0f87ff] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:12.704319 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-2d22522a-2f6b-4256-978a-0051dc15cd86 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:12.704754 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-2d22522a-2f6b-4256-978a-0051dc15cd86 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:12.705643 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-2d22522a-2f6b-4256-978a-0051dc15cd86 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:12.706059 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-2d22522a-2f6b-4256-978a-0051dc15cd86 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:12.804854 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-2d22522a-2f6b-4256-978a-0051dc15cd86 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "POST /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff/action" status: 200 len: 29813 microversion: 2.20 time: 0.113426 Nov 22 12:21:12.805492 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 205/394] 10.222.0.66 () {62 vars in 1318 bytes} [Mon Nov 22 12:21:12 2021] POST /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff/action => generated 29813 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 12:21:13.281827 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-f813c513-69ca-479f-9e4c-0ccf99992dac tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:21:13.282589 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-f813c513-69ca-479f-9e4c-0ccf99992dac tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] [instance: c30dcb83-017d-4428-9150-b68e8835ca64] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:13.289360 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-f813c513-69ca-479f-9e4c-0ccf99992dac tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:13.289811 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-f813c513-69ca-479f-9e4c-0ccf99992dac tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:13.290905 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-f813c513-69ca-479f-9e4c-0ccf99992dac tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:13.291376 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-f813c513-69ca-479f-9e4c-0ccf99992dac tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:13.440515 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-f813c513-69ca-479f-9e4c-0ccf99992dac tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8989f156c213442795edd8b9195bcbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad46aac0327b4760bef46d579031abd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:21:13.444677 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-ebbbc2f6-839f-408c-8bfe-00d2880dbf82 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:21:13.445380 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-ebbbc2f6-839f-408c-8bfe-00d2880dbf82 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] [instance: 302ab8ef-5565-4f9b-9b91-b405d550a90d] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:13.448454 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-f813c513-69ca-479f-9e4c-0ccf99992dac tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] 10.222.0.66 "GET /compute/v2.1/servers/c30dcb83-017d-4428-9150-b68e8835ca64" status: 200 len: 1314 microversion: 2.1 time: 0.170468 Nov 22 12:21:13.451258 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 190/395] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:21:13 2021] GET /compute/v2.1/servers/c30dcb83-017d-4428-9150-b68e8835ca64 => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:21:13.452542 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-ebbbc2f6-839f-408c-8bfe-00d2880dbf82 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:13.452992 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-ebbbc2f6-839f-408c-8bfe-00d2880dbf82 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:13.453860 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-ebbbc2f6-839f-408c-8bfe-00d2880dbf82 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:13.454301 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-ebbbc2f6-839f-408c-8bfe-00d2880dbf82 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:13.508905 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-423f7e67-211e-4bc9-8e82-f5ac44ca8ae5 tempest-VolumesNegativeTest-1241195036 tempest-VolumesNegativeTest-1241195036-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:21:13.509669 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-423f7e67-211e-4bc9-8e82-f5ac44ca8ae5 tempest-VolumesNegativeTest-1241195036 tempest-VolumesNegativeTest-1241195036-project] [instance: 185570a5-ac44-4263-bf37-09b34256de29] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:13.516318 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-423f7e67-211e-4bc9-8e82-f5ac44ca8ae5 tempest-VolumesNegativeTest-1241195036 tempest-VolumesNegativeTest-1241195036-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:13.516929 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-423f7e67-211e-4bc9-8e82-f5ac44ca8ae5 tempest-VolumesNegativeTest-1241195036 tempest-VolumesNegativeTest-1241195036-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:13.517752 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-423f7e67-211e-4bc9-8e82-f5ac44ca8ae5 tempest-VolumesNegativeTest-1241195036 tempest-VolumesNegativeTest-1241195036-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:13.518195 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-423f7e67-211e-4bc9-8e82-f5ac44ca8ae5 tempest-VolumesNegativeTest-1241195036 tempest-VolumesNegativeTest-1241195036-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:13.640241 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-ebbbc2f6-839f-408c-8bfe-00d2880dbf82 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1efac6c215148ce8c3ecdce1e9a8742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d392a7d77f46fcb4faa017786796fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:21:13.648440 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-ebbbc2f6-839f-408c-8bfe-00d2880dbf82 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] 10.222.0.66 "GET /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d" status: 200 len: 1521 microversion: 2.1 time: 0.216777 Nov 22 12:21:13.649501 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 206/396] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:21:13 2021] GET /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d => generated 1521 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 12:21:13.656402 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [req-9d7ed7bb-dbd9-47e0-8839-ecc1ad4f9c67 req-cf5665fd-63f4-4cff-9f24-0776dd62ae95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d457eff7-4539-4ee1-8c94-c51cd4b5b2c1", "name": "network-vif-plugged", "status": "completed", "tag": "e128f2b8-b093-4adf-809f-77c7db02499c"}]} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:21:13.659498 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 12:21:13.659498 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: warnings.warn(msg) Nov 22 12:21:13.667052 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [req-9d7ed7bb-dbd9-47e0-8839-ecc1ad4f9c67 req-cf5665fd-63f4-4cff-9f24-0776dd62ae95 service nova] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:13.667523 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [req-9d7ed7bb-dbd9-47e0-8839-ecc1ad4f9c67 req-cf5665fd-63f4-4cff-9f24-0776dd62ae95 service nova] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:13.678877 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.compute.server_external_events [req-9d7ed7bb-dbd9-47e0-8839-ecc1ad4f9c67 req-cf5665fd-63f4-4cff-9f24-0776dd62ae95 service nova] Creating event network-vif-plugged:e128f2b8-b093-4adf-809f-77c7db02499c for instance d457eff7-4539-4ee1-8c94-c51cd4b5b2c1 on hv-cinder-76845 Nov 22 12:21:13.683816 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [req-9d7ed7bb-dbd9-47e0-8839-ecc1ad4f9c67 req-cf5665fd-63f4-4cff-9f24-0776dd62ae95 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030984 Nov 22 12:21:13.684402 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 207/397] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Nov 22 12:21:13 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 12:21:13.690032 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-221491c3-9b97-4bfb-97bc-f67803904af1 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:21:13.691186 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-221491c3-9b97-4bfb-97bc-f67803904af1 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: 2306113c-8f98-42fd-8c0c-3dfac98fff21] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:13.698574 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-221491c3-9b97-4bfb-97bc-f67803904af1 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:13.699028 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-221491c3-9b97-4bfb-97bc-f67803904af1 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:13.699915 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-221491c3-9b97-4bfb-97bc-f67803904af1 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:13.700389 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-221491c3-9b97-4bfb-97bc-f67803904af1 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:13.712941 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-423f7e67-211e-4bc9-8e82-f5ac44ca8ae5 tempest-VolumesNegativeTest-1241195036 tempest-VolumesNegativeTest-1241195036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624b59c47f79477f8eb4d433c99f4278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef03c640c58d4cf7af6394cb2ca33af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:21:13.730431 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-423f7e67-211e-4bc9-8e82-f5ac44ca8ae5 tempest-VolumesNegativeTest-1241195036 tempest-VolumesNegativeTest-1241195036-project] 10.222.0.66 "GET /compute/v2.1/servers/185570a5-ac44-4263-bf37-09b34256de29" status: 200 len: 1314 microversion: 2.1 time: 0.225430 Nov 22 12:21:13.731013 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 191/398] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:21:13 2021] GET /compute/v2.1/servers/185570a5-ac44-4263-bf37-09b34256de29 => generated 1314 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 12:21:13.741640 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-39384de5-b0a2-4e5f-9acd-212c706f9505 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:21:13.741764 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-39384de5-b0a2-4e5f-9acd-212c706f9505 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] [instance: d457eff7-4539-4ee1-8c94-c51cd4b5b2c1] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:13.748240 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-39384de5-b0a2-4e5f-9acd-212c706f9505 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:13.748743 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-39384de5-b0a2-4e5f-9acd-212c706f9505 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:13.749583 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-39384de5-b0a2-4e5f-9acd-212c706f9505 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:13.750080 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-39384de5-b0a2-4e5f-9acd-212c706f9505 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:13.809742 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-221491c3-9b97-4bfb-97bc-f67803904af1 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "POST /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21/action" status: 200 len: 14 microversion: 2.1 time: 0.123681 Nov 22 12:21:13.810422 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 208/399] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Nov 22 12:21:13 2021] POST /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21/action => generated 14 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 22 12:21:13.818832 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-dc321c0a-eb91-45a0-89f8-f7c8251be187 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:21:13.819947 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-dc321c0a-eb91-45a0-89f8-f7c8251be187 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: c9f6d441-246f-479e-8e88-ea701c0f87ff] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:13.828120 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-dc321c0a-eb91-45a0-89f8-f7c8251be187 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:13.828884 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-dc321c0a-eb91-45a0-89f8-f7c8251be187 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:13.829687 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-dc321c0a-eb91-45a0-89f8-f7c8251be187 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:13.830110 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-dc321c0a-eb91-45a0-89f8-f7c8251be187 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:13.913583 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-39384de5-b0a2-4e5f-9acd-212c706f9505 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b581fa25045cea9585ae4e707585d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5319fd2dee9b4b47b98f59bca1572ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:21:13.921577 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-39384de5-b0a2-4e5f-9acd-212c706f9505 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] 10.222.0.66 "GET /compute/v2.1/servers/d457eff7-4539-4ee1-8c94-c51cd4b5b2c1" status: 200 len: 1318 microversion: 2.1 time: 0.185077 Nov 22 12:21:13.922341 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 192/400] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:21:13 2021] GET /compute/v2.1/servers/d457eff7-4539-4ee1-8c94-c51cd4b5b2c1 => generated 1318 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:21:13.949995 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-dc321c0a-eb91-45a0-89f8-f7c8251be187 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "POST /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff/action" status: 200 len: 30308 microversion: 2.20 time: 0.135320 Nov 22 12:21:13.950626 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 209/401] 10.222.0.66 () {62 vars in 1318 bytes} [Mon Nov 22 12:21:13 2021] POST /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff/action => generated 30308 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 22 12:21:14.465990 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-54667132-727e-402e-b68e-a9895578a39f tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:21:14.466679 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-54667132-727e-402e-b68e-a9895578a39f tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] [instance: c30dcb83-017d-4428-9150-b68e8835ca64] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:14.472967 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-54667132-727e-402e-b68e-a9895578a39f tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:14.473442 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-54667132-727e-402e-b68e-a9895578a39f tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:14.474233 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-54667132-727e-402e-b68e-a9895578a39f tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:14.474656 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-54667132-727e-402e-b68e-a9895578a39f tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:14.620245 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-54667132-727e-402e-b68e-a9895578a39f tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8989f156c213442795edd8b9195bcbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad46aac0327b4760bef46d579031abd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:21:14.628392 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-54667132-727e-402e-b68e-a9895578a39f tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] 10.222.0.66 "GET /compute/v2.1/servers/c30dcb83-017d-4428-9150-b68e8835ca64" status: 200 len: 1314 microversion: 2.1 time: 0.166385 Nov 22 12:21:14.628967 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 193/402] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:21:14 2021] GET /compute/v2.1/servers/c30dcb83-017d-4428-9150-b68e8835ca64 => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:21:14.666855 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-33a252e3-be86-4641-b546-57c388442096 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:21:14.668038 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-33a252e3-be86-4641-b546-57c388442096 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] [instance: 302ab8ef-5565-4f9b-9b91-b405d550a90d] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:14.677646 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-33a252e3-be86-4641-b546-57c388442096 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:14.678091 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-33a252e3-be86-4641-b546-57c388442096 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:14.678854 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-33a252e3-be86-4641-b546-57c388442096 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:14.679335 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-33a252e3-be86-4641-b546-57c388442096 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:14.748950 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-a870c799-14f7-4537-beb6-97ecb6481f30 tempest-VolumesNegativeTest-1241195036 tempest-VolumesNegativeTest-1241195036-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:21:14.749560 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-a870c799-14f7-4537-beb6-97ecb6481f30 tempest-VolumesNegativeTest-1241195036 tempest-VolumesNegativeTest-1241195036-project] [instance: 185570a5-ac44-4263-bf37-09b34256de29] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:14.756891 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-a870c799-14f7-4537-beb6-97ecb6481f30 tempest-VolumesNegativeTest-1241195036 tempest-VolumesNegativeTest-1241195036-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:14.757324 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-a870c799-14f7-4537-beb6-97ecb6481f30 tempest-VolumesNegativeTest-1241195036 tempest-VolumesNegativeTest-1241195036-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:14.758305 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-a870c799-14f7-4537-beb6-97ecb6481f30 tempest-VolumesNegativeTest-1241195036 tempest-VolumesNegativeTest-1241195036-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:14.758864 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-a870c799-14f7-4537-beb6-97ecb6481f30 tempest-VolumesNegativeTest-1241195036 tempest-VolumesNegativeTest-1241195036-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:14.849708 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-33a252e3-be86-4641-b546-57c388442096 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1efac6c215148ce8c3ecdce1e9a8742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d392a7d77f46fcb4faa017786796fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:21:14.861143 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-33a252e3-be86-4641-b546-57c388442096 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] 10.222.0.66 "GET /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d" status: 200 len: 1521 microversion: 2.1 time: 0.198779 Nov 22 12:21:14.861744 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 210/403] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:21:14 2021] GET /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d => generated 1521 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:21:14.866154 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-b1a6078e-2d75-44d8-90c4-679b677032f6 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:21:14.867058 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-b1a6078e-2d75-44d8-90c4-679b677032f6 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: 2306113c-8f98-42fd-8c0c-3dfac98fff21] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:14.873312 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-b1a6078e-2d75-44d8-90c4-679b677032f6 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:14.873781 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-b1a6078e-2d75-44d8-90c4-679b677032f6 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:14.874558 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-b1a6078e-2d75-44d8-90c4-679b677032f6 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:14.875045 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-b1a6078e-2d75-44d8-90c4-679b677032f6 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:14.922037 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-a870c799-14f7-4537-beb6-97ecb6481f30 tempest-VolumesNegativeTest-1241195036 tempest-VolumesNegativeTest-1241195036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624b59c47f79477f8eb4d433c99f4278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef03c640c58d4cf7af6394cb2ca33af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:21:14.929986 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-a870c799-14f7-4537-beb6-97ecb6481f30 tempest-VolumesNegativeTest-1241195036 tempest-VolumesNegativeTest-1241195036-project] 10.222.0.66 "GET /compute/v2.1/servers/185570a5-ac44-4263-bf37-09b34256de29" status: 200 len: 1464 microversion: 2.1 time: 0.184735 Nov 22 12:21:14.930553 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 194/404] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:21:14 2021] GET /compute/v2.1/servers/185570a5-ac44-4263-bf37-09b34256de29 => generated 1464 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:21:14.937113 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-8008956a-7c4e-4465-8d12-4ba8cf67dd61 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:21:14.937802 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-8008956a-7c4e-4465-8d12-4ba8cf67dd61 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] [instance: d457eff7-4539-4ee1-8c94-c51cd4b5b2c1] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:14.944468 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-8008956a-7c4e-4465-8d12-4ba8cf67dd61 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:14.944852 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-8008956a-7c4e-4465-8d12-4ba8cf67dd61 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:14.945632 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-8008956a-7c4e-4465-8d12-4ba8cf67dd61 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:14.946064 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-8008956a-7c4e-4465-8d12-4ba8cf67dd61 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:14.962563 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-b1a6078e-2d75-44d8-90c4-679b677032f6 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "POST /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21/action" status: 200 len: 14 microversion: 2.1 time: 0.099621 Nov 22 12:21:14.963517 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 211/405] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Nov 22 12:21:14 2021] POST /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21/action => generated 14 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 22 12:21:14.968531 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-199f0003-3a48-4bd3-bc31-16a516099aa2 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:21:14.970174 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-199f0003-3a48-4bd3-bc31-16a516099aa2 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: c9f6d441-246f-479e-8e88-ea701c0f87ff] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:14.977355 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-199f0003-3a48-4bd3-bc31-16a516099aa2 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:14.977824 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-199f0003-3a48-4bd3-bc31-16a516099aa2 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:14.978808 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-199f0003-3a48-4bd3-bc31-16a516099aa2 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:14.979298 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-199f0003-3a48-4bd3-bc31-16a516099aa2 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:15.086864 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-8008956a-7c4e-4465-8d12-4ba8cf67dd61 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b581fa25045cea9585ae4e707585d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5319fd2dee9b4b47b98f59bca1572ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:21:15.095290 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-8008956a-7c4e-4465-8d12-4ba8cf67dd61 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] 10.222.0.66 "GET /compute/v2.1/servers/d457eff7-4539-4ee1-8c94-c51cd4b5b2c1" status: 200 len: 1318 microversion: 2.1 time: 0.161365 Nov 22 12:21:15.095892 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 195/406] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:21:14 2021] GET /compute/v2.1/servers/d457eff7-4539-4ee1-8c94-c51cd4b5b2c1 => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:21:15.100135 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-0190bfe3-9217-4f01-871b-08b403e00dc9 tempest-VolumesNegativeTest-1241195036 tempest-VolumesNegativeTest-1241195036-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:21:15.100631 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-0190bfe3-9217-4f01-871b-08b403e00dc9 tempest-VolumesNegativeTest-1241195036 tempest-VolumesNegativeTest-1241195036-project] [instance: 185570a5-ac44-4263-bf37-09b34256de29] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:15.107047 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-0190bfe3-9217-4f01-871b-08b403e00dc9 tempest-VolumesNegativeTest-1241195036 tempest-VolumesNegativeTest-1241195036-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:15.107631 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-0190bfe3-9217-4f01-871b-08b403e00dc9 tempest-VolumesNegativeTest-1241195036 tempest-VolumesNegativeTest-1241195036-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:15.108395 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-0190bfe3-9217-4f01-871b-08b403e00dc9 tempest-VolumesNegativeTest-1241195036 tempest-VolumesNegativeTest-1241195036-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:15.108826 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-0190bfe3-9217-4f01-871b-08b403e00dc9 tempest-VolumesNegativeTest-1241195036 tempest-VolumesNegativeTest-1241195036-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:15.134762 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-0190bfe3-9217-4f01-871b-08b403e00dc9 tempest-VolumesNegativeTest-1241195036 tempest-VolumesNegativeTest-1241195036-project] [instance: 185570a5-ac44-4263-bf37-09b34256de29] Going to try to terminate instance {{(pid=116273) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 22 12:21:15.136661 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-199f0003-3a48-4bd3-bc31-16a516099aa2 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "POST /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff/action" status: 200 len: 30856 microversion: 2.20 time: 0.171733 Nov 22 12:21:15.137449 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 212/407] 10.222.0.66 () {62 vars in 1318 bytes} [Mon Nov 22 12:21:14 2021] POST /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff/action => generated 30856 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 12:21:15.226798 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-0190bfe3-9217-4f01-871b-08b403e00dc9 tempest-VolumesNegativeTest-1241195036 tempest-VolumesNegativeTest-1241195036-project] 10.222.0.66 "DELETE /compute/v2.1/servers/185570a5-ac44-4263-bf37-09b34256de29" status: 204 len: 0 microversion: 2.1 time: 0.129646 Nov 22 12:21:15.227491 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 196/408] 10.222.0.66 () {58 vars in 1238 bytes} [Mon Nov 22 12:21:15 2021] DELETE /compute/v2.1/servers/185570a5-ac44-4263-bf37-09b34256de29 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 22 12:21:15.236613 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-86986e42-26ff-417d-ac83-acda74a1cb22 tempest-VolumesNegativeTest-1241195036 tempest-VolumesNegativeTest-1241195036-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:21:15.237315 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-86986e42-26ff-417d-ac83-acda74a1cb22 tempest-VolumesNegativeTest-1241195036 tempest-VolumesNegativeTest-1241195036-project] [instance: 185570a5-ac44-4263-bf37-09b34256de29] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:15.244365 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-86986e42-26ff-417d-ac83-acda74a1cb22 tempest-VolumesNegativeTest-1241195036 tempest-VolumesNegativeTest-1241195036-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:15.244816 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-86986e42-26ff-417d-ac83-acda74a1cb22 tempest-VolumesNegativeTest-1241195036 tempest-VolumesNegativeTest-1241195036-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:15.245607 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-86986e42-26ff-417d-ac83-acda74a1cb22 tempest-VolumesNegativeTest-1241195036 tempest-VolumesNegativeTest-1241195036-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:15.246045 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-86986e42-26ff-417d-ac83-acda74a1cb22 tempest-VolumesNegativeTest-1241195036 tempest-VolumesNegativeTest-1241195036-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:15.389773 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-86986e42-26ff-417d-ac83-acda74a1cb22 tempest-VolumesNegativeTest-1241195036 tempest-VolumesNegativeTest-1241195036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624b59c47f79477f8eb4d433c99f4278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef03c640c58d4cf7af6394cb2ca33af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:21:15.397661 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-86986e42-26ff-417d-ac83-acda74a1cb22 tempest-VolumesNegativeTest-1241195036 tempest-VolumesNegativeTest-1241195036-project] 10.222.0.66 "GET /compute/v2.1/servers/185570a5-ac44-4263-bf37-09b34256de29" status: 200 len: 1470 microversion: 2.1 time: 0.165000 Nov 22 12:21:15.398246 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 213/409] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:21:15 2021] GET /compute/v2.1/servers/185570a5-ac44-4263-bf37-09b34256de29 => generated 1470 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:21:15.649542 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-9fb176d5-4fc8-44b3-ac9b-c59f2a6b4785 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:21:15.650243 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-9fb176d5-4fc8-44b3-ac9b-c59f2a6b4785 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] [instance: c30dcb83-017d-4428-9150-b68e8835ca64] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:15.656603 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-9fb176d5-4fc8-44b3-ac9b-c59f2a6b4785 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:15.657047 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-9fb176d5-4fc8-44b3-ac9b-c59f2a6b4785 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:15.657941 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-9fb176d5-4fc8-44b3-ac9b-c59f2a6b4785 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:15.658360 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-9fb176d5-4fc8-44b3-ac9b-c59f2a6b4785 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:15.805319 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-9fb176d5-4fc8-44b3-ac9b-c59f2a6b4785 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8989f156c213442795edd8b9195bcbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad46aac0327b4760bef46d579031abd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:21:15.816072 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-9fb176d5-4fc8-44b3-ac9b-c59f2a6b4785 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] 10.222.0.66 "GET /compute/v2.1/servers/c30dcb83-017d-4428-9150-b68e8835ca64" status: 200 len: 1314 microversion: 2.1 time: 0.170352 Nov 22 12:21:15.816796 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 197/410] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:21:15 2021] GET /compute/v2.1/servers/c30dcb83-017d-4428-9150-b68e8835ca64 => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:21:15.877905 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-68523d31-df70-4c3e-a9cf-962c1717b84e tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:21:15.878492 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-68523d31-df70-4c3e-a9cf-962c1717b84e tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] [instance: 302ab8ef-5565-4f9b-9b91-b405d550a90d] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:15.885009 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-68523d31-df70-4c3e-a9cf-962c1717b84e tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:15.885455 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-68523d31-df70-4c3e-a9cf-962c1717b84e tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:15.886243 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-68523d31-df70-4c3e-a9cf-962c1717b84e tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:15.886665 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-68523d31-df70-4c3e-a9cf-962c1717b84e tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:15.974083 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-152de596-500f-43c2-b001-048ff1fa2c98 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:21:15.975102 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-152de596-500f-43c2-b001-048ff1fa2c98 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: 2306113c-8f98-42fd-8c0c-3dfac98fff21] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:15.981334 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-152de596-500f-43c2-b001-048ff1fa2c98 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:15.981784 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-152de596-500f-43c2-b001-048ff1fa2c98 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:15.982746 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-152de596-500f-43c2-b001-048ff1fa2c98 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:15.983186 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-152de596-500f-43c2-b001-048ff1fa2c98 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:16.026185 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-68523d31-df70-4c3e-a9cf-962c1717b84e tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1efac6c215148ce8c3ecdce1e9a8742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d392a7d77f46fcb4faa017786796fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:21:16.034720 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-68523d31-df70-4c3e-a9cf-962c1717b84e tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] 10.222.0.66 "GET /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d" status: 200 len: 1521 microversion: 2.1 time: 0.160803 Nov 22 12:21:16.035285 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 214/411] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:21:15 2021] GET /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:21:16.119047 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-ac687b66-3d64-4020-b9b3-62810de5793a tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:21:16.119796 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-ac687b66-3d64-4020-b9b3-62810de5793a tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] [instance: d457eff7-4539-4ee1-8c94-c51cd4b5b2c1] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:16.126309 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-152de596-500f-43c2-b001-048ff1fa2c98 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "POST /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21/action" status: 200 len: 14 microversion: 2.1 time: 0.155717 Nov 22 12:21:16.129603 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 198/412] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Nov 22 12:21:15 2021] POST /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21/action => generated 14 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 22 12:21:16.129745 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-ac687b66-3d64-4020-b9b3-62810de5793a tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:16.129745 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-ac687b66-3d64-4020-b9b3-62810de5793a tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:16.129745 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-ac687b66-3d64-4020-b9b3-62810de5793a tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:16.129960 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-ac687b66-3d64-4020-b9b3-62810de5793a tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:16.150489 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-c77b213a-cc2c-469c-914e-ec55dcf10d7b tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:21:16.152367 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-c77b213a-cc2c-469c-914e-ec55dcf10d7b tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: c9f6d441-246f-479e-8e88-ea701c0f87ff] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:16.163357 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-c77b213a-cc2c-469c-914e-ec55dcf10d7b tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:16.163962 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-c77b213a-cc2c-469c-914e-ec55dcf10d7b tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:16.165367 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-c77b213a-cc2c-469c-914e-ec55dcf10d7b tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:16.165846 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-c77b213a-cc2c-469c-914e-ec55dcf10d7b tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:16.273483 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-ac687b66-3d64-4020-b9b3-62810de5793a tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b581fa25045cea9585ae4e707585d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5319fd2dee9b4b47b98f59bca1572ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:21:16.284041 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-ac687b66-3d64-4020-b9b3-62810de5793a tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] 10.222.0.66 "GET /compute/v2.1/servers/d457eff7-4539-4ee1-8c94-c51cd4b5b2c1" status: 200 len: 1318 microversion: 2.1 time: 0.168619 Nov 22 12:21:16.284919 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 215/413] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:21:16 2021] GET /compute/v2.1/servers/d457eff7-4539-4ee1-8c94-c51cd4b5b2c1 => generated 1318 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 12:21:16.313536 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-c77b213a-cc2c-469c-914e-ec55dcf10d7b tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "POST /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff/action" status: 200 len: 31402 microversion: 2.20 time: 0.167558 Nov 22 12:21:16.314172 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 199/414] 10.222.0.66 () {62 vars in 1318 bytes} [Mon Nov 22 12:21:16 2021] POST /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff/action => generated 31402 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 12:21:16.416194 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-6e2c7683-1bd5-4f18-b8cb-ec2bd5275c1c tempest-VolumesNegativeTest-1241195036 tempest-VolumesNegativeTest-1241195036-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:21:16.416796 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-6e2c7683-1bd5-4f18-b8cb-ec2bd5275c1c tempest-VolumesNegativeTest-1241195036 tempest-VolumesNegativeTest-1241195036-project] [instance: 185570a5-ac44-4263-bf37-09b34256de29] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:16.423378 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-6e2c7683-1bd5-4f18-b8cb-ec2bd5275c1c tempest-VolumesNegativeTest-1241195036 tempest-VolumesNegativeTest-1241195036-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:16.423817 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-6e2c7683-1bd5-4f18-b8cb-ec2bd5275c1c tempest-VolumesNegativeTest-1241195036 tempest-VolumesNegativeTest-1241195036-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:16.424602 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-6e2c7683-1bd5-4f18-b8cb-ec2bd5275c1c tempest-VolumesNegativeTest-1241195036 tempest-VolumesNegativeTest-1241195036-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:16.425033 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-6e2c7683-1bd5-4f18-b8cb-ec2bd5275c1c tempest-VolumesNegativeTest-1241195036 tempest-VolumesNegativeTest-1241195036-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:16.569387 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-6e2c7683-1bd5-4f18-b8cb-ec2bd5275c1c tempest-VolumesNegativeTest-1241195036 tempest-VolumesNegativeTest-1241195036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624b59c47f79477f8eb4d433c99f4278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef03c640c58d4cf7af6394cb2ca33af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:21:16.577146 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-6e2c7683-1bd5-4f18-b8cb-ec2bd5275c1c tempest-VolumesNegativeTest-1241195036 tempest-VolumesNegativeTest-1241195036-project] 10.222.0.66 "GET /compute/v2.1/servers/185570a5-ac44-4263-bf37-09b34256de29" status: 200 len: 1470 microversion: 2.1 time: 0.164958 Nov 22 12:21:16.577785 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 216/415] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:21:16 2021] GET /compute/v2.1/servers/185570a5-ac44-4263-bf37-09b34256de29 => generated 1470 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:21:16.838426 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-56bd3934-7c86-45a9-88cc-d2b97fb42cc0 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:21:16.839818 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-56bd3934-7c86-45a9-88cc-d2b97fb42cc0 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] [instance: c30dcb83-017d-4428-9150-b68e8835ca64] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:16.848654 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-56bd3934-7c86-45a9-88cc-d2b97fb42cc0 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:16.849087 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-56bd3934-7c86-45a9-88cc-d2b97fb42cc0 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:16.849911 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-56bd3934-7c86-45a9-88cc-d2b97fb42cc0 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:16.850347 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-56bd3934-7c86-45a9-88cc-d2b97fb42cc0 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:16.985820 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-56bd3934-7c86-45a9-88cc-d2b97fb42cc0 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8989f156c213442795edd8b9195bcbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad46aac0327b4760bef46d579031abd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:21:16.993911 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-56bd3934-7c86-45a9-88cc-d2b97fb42cc0 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] 10.222.0.66 "GET /compute/v2.1/servers/c30dcb83-017d-4428-9150-b68e8835ca64" status: 200 len: 1314 microversion: 2.1 time: 0.161686 Nov 22 12:21:16.994439 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 200/416] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:21:16 2021] GET /compute/v2.1/servers/c30dcb83-017d-4428-9150-b68e8835ca64 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:21:17.052424 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-252cc396-8714-44d8-ac70-3c7808dd821a tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:21:17.052981 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-252cc396-8714-44d8-ac70-3c7808dd821a tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] [instance: 302ab8ef-5565-4f9b-9b91-b405d550a90d] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:17.059955 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-252cc396-8714-44d8-ac70-3c7808dd821a tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:17.060419 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-252cc396-8714-44d8-ac70-3c7808dd821a tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:17.061195 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-252cc396-8714-44d8-ac70-3c7808dd821a tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:17.061630 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-252cc396-8714-44d8-ac70-3c7808dd821a tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:17.137529 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-d1551ecb-a744-4e43-bf4e-b00a0840ccf0 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:21:17.138425 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-d1551ecb-a744-4e43-bf4e-b00a0840ccf0 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: 2306113c-8f98-42fd-8c0c-3dfac98fff21] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:17.145441 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-d1551ecb-a744-4e43-bf4e-b00a0840ccf0 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:17.145897 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-d1551ecb-a744-4e43-bf4e-b00a0840ccf0 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:17.146687 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-d1551ecb-a744-4e43-bf4e-b00a0840ccf0 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:17.147127 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-d1551ecb-a744-4e43-bf4e-b00a0840ccf0 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:17.213859 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-252cc396-8714-44d8-ac70-3c7808dd821a tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1efac6c215148ce8c3ecdce1e9a8742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d392a7d77f46fcb4faa017786796fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:21:17.222261 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-252cc396-8714-44d8-ac70-3c7808dd821a tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] 10.222.0.66 "GET /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d" status: 200 len: 1521 microversion: 2.1 time: 0.173548 Nov 22 12:21:17.222826 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 217/417] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:21:17 2021] GET /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:21:17.231359 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-d1551ecb-a744-4e43-bf4e-b00a0840ccf0 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "POST /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21/action" status: 200 len: 14 microversion: 2.1 time: 0.097486 Nov 22 12:21:17.232000 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 201/418] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Nov 22 12:21:17 2021] POST /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21/action => generated 14 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 22 12:21:17.305817 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-efc83291-4986-4593-a999-d518938fb3cc tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:21:17.306557 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-efc83291-4986-4593-a999-d518938fb3cc tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] [instance: d457eff7-4539-4ee1-8c94-c51cd4b5b2c1] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:17.315221 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-efc83291-4986-4593-a999-d518938fb3cc tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:17.315703 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-efc83291-4986-4593-a999-d518938fb3cc tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:17.316574 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-efc83291-4986-4593-a999-d518938fb3cc tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:17.317007 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-efc83291-4986-4593-a999-d518938fb3cc tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:17.326392 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-5a736763-f149-4552-8928-f0982b08840a tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:21:17.327423 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-5a736763-f149-4552-8928-f0982b08840a tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: c9f6d441-246f-479e-8e88-ea701c0f87ff] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:17.334398 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-5a736763-f149-4552-8928-f0982b08840a tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:17.334843 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-5a736763-f149-4552-8928-f0982b08840a tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:17.335642 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-5a736763-f149-4552-8928-f0982b08840a tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:17.336068 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-5a736763-f149-4552-8928-f0982b08840a tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:17.450592 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-5a736763-f149-4552-8928-f0982b08840a tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "POST /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff/action" status: 200 len: 31882 microversion: 2.20 time: 0.128258 Nov 22 12:21:17.451369 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 202/419] 10.222.0.66 () {62 vars in 1318 bytes} [Mon Nov 22 12:21:17 2021] POST /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff/action => generated 31882 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 12:21:17.461397 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-efc83291-4986-4593-a999-d518938fb3cc tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b581fa25045cea9585ae4e707585d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5319fd2dee9b4b47b98f59bca1572ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:21:17.469142 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-efc83291-4986-4593-a999-d518938fb3cc tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] 10.222.0.66 "GET /compute/v2.1/servers/d457eff7-4539-4ee1-8c94-c51cd4b5b2c1" status: 200 len: 1507 microversion: 2.1 time: 0.169365 Nov 22 12:21:17.469749 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 218/420] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:21:17 2021] GET /compute/v2.1/servers/d457eff7-4539-4ee1-8c94-c51cd4b5b2c1 => generated 1507 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:21:17.595141 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-d2f9b1f1-3636-408c-9252-a4a209eb184a tempest-VolumesNegativeTest-1241195036 tempest-VolumesNegativeTest-1241195036-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:21:17.596982 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-d2f9b1f1-3636-408c-9252-a4a209eb184a tempest-VolumesNegativeTest-1241195036 tempest-VolumesNegativeTest-1241195036-project] [instance: 185570a5-ac44-4263-bf37-09b34256de29] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:17.606378 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-d2f9b1f1-3636-408c-9252-a4a209eb184a tempest-VolumesNegativeTest-1241195036 tempest-VolumesNegativeTest-1241195036-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:17.607002 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-d2f9b1f1-3636-408c-9252-a4a209eb184a tempest-VolumesNegativeTest-1241195036 tempest-VolumesNegativeTest-1241195036-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:17.607883 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-d2f9b1f1-3636-408c-9252-a4a209eb184a tempest-VolumesNegativeTest-1241195036 tempest-VolumesNegativeTest-1241195036-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:17.608588 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-d2f9b1f1-3636-408c-9252-a4a209eb184a tempest-VolumesNegativeTest-1241195036 tempest-VolumesNegativeTest-1241195036-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:17.774419 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-d2f9b1f1-3636-408c-9252-a4a209eb184a tempest-VolumesNegativeTest-1241195036 tempest-VolumesNegativeTest-1241195036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624b59c47f79477f8eb4d433c99f4278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef03c640c58d4cf7af6394cb2ca33af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:21:17.783716 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-d2f9b1f1-3636-408c-9252-a4a209eb184a tempest-VolumesNegativeTest-1241195036 tempest-VolumesNegativeTest-1241195036-project] 10.222.0.66 "GET /compute/v2.1/servers/185570a5-ac44-4263-bf37-09b34256de29" status: 200 len: 1470 microversion: 2.1 time: 0.193271 Nov 22 12:21:17.789207 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 203/421] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:21:17 2021] GET /compute/v2.1/servers/185570a5-ac44-4263-bf37-09b34256de29 => generated 1470 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:21:18.014944 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-f22a30e2-380e-4ff2-96d8-12bc5c0d20f4 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:21:18.016250 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-f22a30e2-380e-4ff2-96d8-12bc5c0d20f4 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] [instance: c30dcb83-017d-4428-9150-b68e8835ca64] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:18.022708 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-f22a30e2-380e-4ff2-96d8-12bc5c0d20f4 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:18.023154 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-f22a30e2-380e-4ff2-96d8-12bc5c0d20f4 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:18.023977 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-f22a30e2-380e-4ff2-96d8-12bc5c0d20f4 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:18.024412 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-f22a30e2-380e-4ff2-96d8-12bc5c0d20f4 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:18.159099 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-f22a30e2-380e-4ff2-96d8-12bc5c0d20f4 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8989f156c213442795edd8b9195bcbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad46aac0327b4760bef46d579031abd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:21:18.170520 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-f22a30e2-380e-4ff2-96d8-12bc5c0d20f4 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] 10.222.0.66 "GET /compute/v2.1/servers/c30dcb83-017d-4428-9150-b68e8835ca64" status: 200 len: 1314 microversion: 2.1 time: 0.162380 Nov 22 12:21:18.171256 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 219/422] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:21:18 2021] GET /compute/v2.1/servers/c30dcb83-017d-4428-9150-b68e8835ca64 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:21:18.241198 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-91ff017b-dccd-4e37-b4bf-0f3a38fdc98c tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:21:18.241814 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-91ff017b-dccd-4e37-b4bf-0f3a38fdc98c tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] [instance: 302ab8ef-5565-4f9b-9b91-b405d550a90d] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:18.242337 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-a97e124e-2970-4d4f-bb70-53a71eed1270 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:21:18.243377 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-a97e124e-2970-4d4f-bb70-53a71eed1270 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: 2306113c-8f98-42fd-8c0c-3dfac98fff21] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:18.248348 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-91ff017b-dccd-4e37-b4bf-0f3a38fdc98c tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:18.248865 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-91ff017b-dccd-4e37-b4bf-0f3a38fdc98c tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:18.249648 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-91ff017b-dccd-4e37-b4bf-0f3a38fdc98c tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:18.250171 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-a97e124e-2970-4d4f-bb70-53a71eed1270 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:18.250335 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-91ff017b-dccd-4e37-b4bf-0f3a38fdc98c tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:18.250630 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-a97e124e-2970-4d4f-bb70-53a71eed1270 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:18.251448 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-a97e124e-2970-4d4f-bb70-53a71eed1270 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:18.251881 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-a97e124e-2970-4d4f-bb70-53a71eed1270 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:18.352256 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-a97e124e-2970-4d4f-bb70-53a71eed1270 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "POST /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21/action" status: 200 len: 14 microversion: 2.1 time: 0.113412 Nov 22 12:21:18.353017 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 220/423] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Nov 22 12:21:18 2021] POST /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21/action => generated 14 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 22 12:21:18.396876 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-91ff017b-dccd-4e37-b4bf-0f3a38fdc98c tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1efac6c215148ce8c3ecdce1e9a8742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d392a7d77f46fcb4faa017786796fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:21:18.404839 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-91ff017b-dccd-4e37-b4bf-0f3a38fdc98c tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] 10.222.0.66 "GET /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d" status: 200 len: 1521 microversion: 2.1 time: 0.167595 Nov 22 12:21:18.405397 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 204/424] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:21:18 2021] GET /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:21:18.463560 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-27b83462-f4d0-4870-b7f3-4d1d93446535 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:21:18.464562 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-27b83462-f4d0-4870-b7f3-4d1d93446535 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: c9f6d441-246f-479e-8e88-ea701c0f87ff] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:18.471845 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-27b83462-f4d0-4870-b7f3-4d1d93446535 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:18.472293 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-27b83462-f4d0-4870-b7f3-4d1d93446535 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:18.473065 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-27b83462-f4d0-4870-b7f3-4d1d93446535 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:18.473506 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-27b83462-f4d0-4870-b7f3-4d1d93446535 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:18.601203 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-27b83462-f4d0-4870-b7f3-4d1d93446535 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "POST /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff/action" status: 200 len: 32390 microversion: 2.20 time: 0.142484 Nov 22 12:21:18.601867 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 221/425] 10.222.0.66 () {62 vars in 1318 bytes} [Mon Nov 22 12:21:18 2021] POST /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff/action => generated 32390 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 12:21:18.801674 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-f336dbe0-bbee-41f4-97c3-6497e7024254 tempest-VolumesNegativeTest-1241195036 tempest-VolumesNegativeTest-1241195036-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:21:18.802777 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-f336dbe0-bbee-41f4-97c3-6497e7024254 tempest-VolumesNegativeTest-1241195036 tempest-VolumesNegativeTest-1241195036-project] [instance: 185570a5-ac44-4263-bf37-09b34256de29] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:18.809443 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-f336dbe0-bbee-41f4-97c3-6497e7024254 tempest-VolumesNegativeTest-1241195036 tempest-VolumesNegativeTest-1241195036-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:18.809881 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-f336dbe0-bbee-41f4-97c3-6497e7024254 tempest-VolumesNegativeTest-1241195036 tempest-VolumesNegativeTest-1241195036-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:18.810704 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-f336dbe0-bbee-41f4-97c3-6497e7024254 tempest-VolumesNegativeTest-1241195036 tempest-VolumesNegativeTest-1241195036-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:18.811148 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-f336dbe0-bbee-41f4-97c3-6497e7024254 tempest-VolumesNegativeTest-1241195036 tempest-VolumesNegativeTest-1241195036-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:18.826808 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-8cf35df2-1a2b-477e-92fb-44d8a0a61a77 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d845c8ca-b2bb-419f-a375-9dd7e913dfc6"}} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:21:18.828016 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-8cf35df2-1a2b-477e-92fb-44d8a0a61a77 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] [instance: d457eff7-4539-4ee1-8c94-c51cd4b5b2c1] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:18.836325 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-8cf35df2-1a2b-477e-92fb-44d8a0a61a77 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:18.836882 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-8cf35df2-1a2b-477e-92fb-44d8a0a61a77 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:18.837684 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-8cf35df2-1a2b-477e-92fb-44d8a0a61a77 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:18.838126 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-8cf35df2-1a2b-477e-92fb-44d8a0a61a77 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:18.958330 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-f336dbe0-bbee-41f4-97c3-6497e7024254 tempest-VolumesNegativeTest-1241195036 tempest-VolumesNegativeTest-1241195036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624b59c47f79477f8eb4d433c99f4278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef03c640c58d4cf7af6394cb2ca33af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:21:18.967836 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-f336dbe0-bbee-41f4-97c3-6497e7024254 tempest-VolumesNegativeTest-1241195036 tempest-VolumesNegativeTest-1241195036-project] 10.222.0.66 "GET /compute/v2.1/servers/185570a5-ac44-4263-bf37-09b34256de29" status: 200 len: 1470 microversion: 2.1 time: 0.169980 Nov 22 12:21:18.968567 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 205/426] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:21:18 2021] GET /compute/v2.1/servers/185570a5-ac44-4263-bf37-09b34256de29 => generated 1470 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:21:19.145547 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-8cf35df2-1a2b-477e-92fb-44d8a0a61a77 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] 10.222.0.66 "POST /compute/v2.1/servers/d457eff7-4539-4ee1-8c94-c51cd4b5b2c1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.322628 Nov 22 12:21:19.146235 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 222/427] 10.222.0.66 () {60 vars in 1322 bytes} [Mon Nov 22 12:21:18 2021] POST /compute/v2.1/servers/d457eff7-4539-4ee1-8c94-c51cd4b5b2c1/os-volume_attachments => generated 194 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 12:21:19.194153 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-048bc82a-b2c2-452d-b036-0bc0b622d7f3 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:21:19.195154 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-048bc82a-b2c2-452d-b036-0bc0b622d7f3 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] [instance: c30dcb83-017d-4428-9150-b68e8835ca64] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:19.202730 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-048bc82a-b2c2-452d-b036-0bc0b622d7f3 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:19.203324 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-048bc82a-b2c2-452d-b036-0bc0b622d7f3 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:19.204604 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-048bc82a-b2c2-452d-b036-0bc0b622d7f3 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:19.205440 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-048bc82a-b2c2-452d-b036-0bc0b622d7f3 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:19.229587 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [req-aa999061-18c0-485a-8e38-b7789c0757ba req-97784ed5-ee72-4617-8a1b-1803660d23bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "185570a5-ac44-4263-bf37-09b34256de29", "name": "network-vif-deleted", "tag": "4064eb13-0c50-40e5-a2ea-9dd0aabf8848"}]} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:21:19.231048 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 12:21:19.231048 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: warnings.warn(msg) Nov 22 12:21:19.243170 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [req-aa999061-18c0-485a-8e38-b7789c0757ba req-97784ed5-ee72-4617-8a1b-1803660d23bc service nova] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:19.243285 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [req-aa999061-18c0-485a-8e38-b7789c0757ba req-97784ed5-ee72-4617-8a1b-1803660d23bc service nova] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:19.259552 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.compute.server_external_events [req-aa999061-18c0-485a-8e38-b7789c0757ba req-97784ed5-ee72-4617-8a1b-1803660d23bc service nova] Creating event network-vif-deleted:4064eb13-0c50-40e5-a2ea-9dd0aabf8848 for instance 185570a5-ac44-4263-bf37-09b34256de29 on hv-cinder-76845 Nov 22 12:21:19.270392 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [req-aa999061-18c0-485a-8e38-b7789c0757ba req-97784ed5-ee72-4617-8a1b-1803660d23bc service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039443 Nov 22 12:21:19.271450 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 223/428] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Nov 22 12:21:19 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 12:21:19.364619 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-11046ac9-0b03-416f-b3e7-27f28b4e0641 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:21:19.365723 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-11046ac9-0b03-416f-b3e7-27f28b4e0641 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: 2306113c-8f98-42fd-8c0c-3dfac98fff21] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:19.375736 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-11046ac9-0b03-416f-b3e7-27f28b4e0641 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:19.380673 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-11046ac9-0b03-416f-b3e7-27f28b4e0641 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:19.381647 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-11046ac9-0b03-416f-b3e7-27f28b4e0641 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:19.382739 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-048bc82a-b2c2-452d-b036-0bc0b622d7f3 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8989f156c213442795edd8b9195bcbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad46aac0327b4760bef46d579031abd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:21:19.383625 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-11046ac9-0b03-416f-b3e7-27f28b4e0641 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:19.391619 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-048bc82a-b2c2-452d-b036-0bc0b622d7f3 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] 10.222.0.66 "GET /compute/v2.1/servers/c30dcb83-017d-4428-9150-b68e8835ca64" status: 200 len: 1314 microversion: 2.1 time: 0.207201 Nov 22 12:21:19.392469 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 206/429] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:21:19 2021] GET /compute/v2.1/servers/c30dcb83-017d-4428-9150-b68e8835ca64 => generated 1314 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 12:21:19.422698 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-1166c18e-210c-4c84-8867-afabf447a7c4 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:21:19.423334 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-1166c18e-210c-4c84-8867-afabf447a7c4 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] [instance: 302ab8ef-5565-4f9b-9b91-b405d550a90d] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:19.429250 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-1166c18e-210c-4c84-8867-afabf447a7c4 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:19.430526 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-1166c18e-210c-4c84-8867-afabf447a7c4 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:19.431751 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-1166c18e-210c-4c84-8867-afabf447a7c4 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:19.432193 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-1166c18e-210c-4c84-8867-afabf447a7c4 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:19.489940 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-11046ac9-0b03-416f-b3e7-27f28b4e0641 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "POST /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21/action" status: 200 len: 14 microversion: 2.1 time: 0.129665 Nov 22 12:21:19.491830 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 224/430] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Nov 22 12:21:19 2021] POST /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21/action => generated 14 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 22 12:21:19.588549 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-1166c18e-210c-4c84-8867-afabf447a7c4 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1efac6c215148ce8c3ecdce1e9a8742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d392a7d77f46fcb4faa017786796fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:21:19.596941 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [req-b3da299d-9155-4620-b87b-c1d1a91179fc req-f713f764-4d79-42da-adf5-207ad89f0d5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c30dcb83-017d-4428-9150-b68e8835ca64", "name": "network-vif-plugged", "status": "completed", "tag": "0bbd7299-c83f-4a3c-bdea-4930e3bb6de3"}]} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:21:19.597908 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-1166c18e-210c-4c84-8867-afabf447a7c4 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] 10.222.0.66 "GET /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d" status: 200 len: 1521 microversion: 2.1 time: 0.179642 Nov 22 12:21:19.611256 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 12:21:19.611256 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: warnings.warn(msg) Nov 22 12:21:19.611549 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 207/431] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:21:19 2021] GET /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d => generated 1521 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 12:21:19.611642 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [req-b3da299d-9155-4620-b87b-c1d1a91179fc req-f713f764-4d79-42da-adf5-207ad89f0d5b service nova] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:19.611642 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [req-b3da299d-9155-4620-b87b-c1d1a91179fc req-f713f764-4d79-42da-adf5-207ad89f0d5b service nova] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:19.618814 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-469a11e8-0007-4de1-a240-ce761c163cd9 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:21:19.620474 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-469a11e8-0007-4de1-a240-ce761c163cd9 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: c9f6d441-246f-479e-8e88-ea701c0f87ff] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:19.621348 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.compute.server_external_events [req-b3da299d-9155-4620-b87b-c1d1a91179fc req-f713f764-4d79-42da-adf5-207ad89f0d5b service nova] Creating event network-vif-plugged:0bbd7299-c83f-4a3c-bdea-4930e3bb6de3 for instance c30dcb83-017d-4428-9150-b68e8835ca64 on hv-cinder-76845 Nov 22 12:21:19.629006 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [req-b3da299d-9155-4620-b87b-c1d1a91179fc req-f713f764-4d79-42da-adf5-207ad89f0d5b service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035187 Nov 22 12:21:19.629203 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 225/432] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Nov 22 12:21:19 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 22 12:21:19.631598 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-469a11e8-0007-4de1-a240-ce761c163cd9 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:19.632462 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-469a11e8-0007-4de1-a240-ce761c163cd9 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:19.633752 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-469a11e8-0007-4de1-a240-ce761c163cd9 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:19.634190 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-469a11e8-0007-4de1-a240-ce761c163cd9 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:19.773503 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-469a11e8-0007-4de1-a240-ce761c163cd9 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "POST /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff/action" status: 200 len: 33001 microversion: 2.20 time: 0.161738 Nov 22 12:21:19.774208 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 208/433] 10.222.0.66 () {62 vars in 1318 bytes} [Mon Nov 22 12:21:19 2021] POST /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff/action => generated 33001 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 22 12:21:19.988124 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-e3ad2427-87dc-490a-b980-ecb87b2304eb tempest-VolumesNegativeTest-1241195036 tempest-VolumesNegativeTest-1241195036-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:21:19.988813 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-e3ad2427-87dc-490a-b980-ecb87b2304eb tempest-VolumesNegativeTest-1241195036 tempest-VolumesNegativeTest-1241195036-project] [instance: 185570a5-ac44-4263-bf37-09b34256de29] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:19.995480 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-e3ad2427-87dc-490a-b980-ecb87b2304eb tempest-VolumesNegativeTest-1241195036 tempest-VolumesNegativeTest-1241195036-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:19.995935 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-e3ad2427-87dc-490a-b980-ecb87b2304eb tempest-VolumesNegativeTest-1241195036 tempest-VolumesNegativeTest-1241195036-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:19.996721 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-e3ad2427-87dc-490a-b980-ecb87b2304eb tempest-VolumesNegativeTest-1241195036 tempest-VolumesNegativeTest-1241195036-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:19.997157 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-e3ad2427-87dc-490a-b980-ecb87b2304eb tempest-VolumesNegativeTest-1241195036 tempest-VolumesNegativeTest-1241195036-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:20.032815 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-e3ad2427-87dc-490a-b980-ecb87b2304eb tempest-VolumesNegativeTest-1241195036 tempest-VolumesNegativeTest-1241195036-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:20.033658 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-e3ad2427-87dc-490a-b980-ecb87b2304eb tempest-VolumesNegativeTest-1241195036 tempest-VolumesNegativeTest-1241195036-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:20.034432 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.objects.instance [None req-e3ad2427-87dc-490a-b980-ecb87b2304eb tempest-VolumesNegativeTest-1241195036 tempest-VolumesNegativeTest-1241195036-project] Lazy-loading 'fault' on Instance uuid 185570a5-ac44-4263-bf37-09b34256de29 {{(pid=116272) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 22 12:21:20.087341 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-e3ad2427-87dc-490a-b980-ecb87b2304eb tempest-VolumesNegativeTest-1241195036 tempest-VolumesNegativeTest-1241195036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624b59c47f79477f8eb4d433c99f4278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef03c640c58d4cf7af6394cb2ca33af8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:21:20.095906 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-e3ad2427-87dc-490a-b980-ecb87b2304eb tempest-VolumesNegativeTest-1241195036 tempest-VolumesNegativeTest-1241195036-project] 10.222.0.66 "GET /compute/v2.1/servers/185570a5-ac44-4263-bf37-09b34256de29" status: 200 len: 1304 microversion: 2.1 time: 0.113591 Nov 22 12:21:20.096536 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 226/434] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:21:19 2021] GET /compute/v2.1/servers/185570a5-ac44-4263-bf37-09b34256de29 => generated 1304 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:21:20.409656 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-173286fd-444f-47e1-b5cc-c43ac76f02e7 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:21:20.410756 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-173286fd-444f-47e1-b5cc-c43ac76f02e7 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] [instance: c30dcb83-017d-4428-9150-b68e8835ca64] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:20.419796 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-173286fd-444f-47e1-b5cc-c43ac76f02e7 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:20.420267 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-173286fd-444f-47e1-b5cc-c43ac76f02e7 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:20.421040 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-173286fd-444f-47e1-b5cc-c43ac76f02e7 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:20.421470 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-173286fd-444f-47e1-b5cc-c43ac76f02e7 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:20.502624 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-ce23aa6d-2b75-4928-b155-01143f83a170 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:21:20.503598 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-ce23aa6d-2b75-4928-b155-01143f83a170 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: 2306113c-8f98-42fd-8c0c-3dfac98fff21] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:20.511404 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-ce23aa6d-2b75-4928-b155-01143f83a170 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:20.511869 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-ce23aa6d-2b75-4928-b155-01143f83a170 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:20.512804 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-ce23aa6d-2b75-4928-b155-01143f83a170 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:20.513124 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-ce23aa6d-2b75-4928-b155-01143f83a170 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:20.564586 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-173286fd-444f-47e1-b5cc-c43ac76f02e7 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8989f156c213442795edd8b9195bcbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad46aac0327b4760bef46d579031abd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:21:20.573431 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-173286fd-444f-47e1-b5cc-c43ac76f02e7 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] 10.222.0.66 "GET /compute/v2.1/servers/c30dcb83-017d-4428-9150-b68e8835ca64" status: 200 len: 1314 microversion: 2.1 time: 0.167962 Nov 22 12:21:20.574001 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 209/435] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:21:20 2021] GET /compute/v2.1/servers/c30dcb83-017d-4428-9150-b68e8835ca64 => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:21:20.620152 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-cbb8cc59-0889-4410-ab6d-d4322e50765f tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:21:20.620761 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-cbb8cc59-0889-4410-ab6d-d4322e50765f tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] [instance: 302ab8ef-5565-4f9b-9b91-b405d550a90d] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:20.627551 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-cbb8cc59-0889-4410-ab6d-d4322e50765f tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:20.628000 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-cbb8cc59-0889-4410-ab6d-d4322e50765f tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:20.628786 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-cbb8cc59-0889-4410-ab6d-d4322e50765f tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:20.629226 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-cbb8cc59-0889-4410-ab6d-d4322e50765f tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:20.656056 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-ce23aa6d-2b75-4928-b155-01143f83a170 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "POST /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21/action" status: 200 len: 14 microversion: 2.1 time: 0.157486 Nov 22 12:21:20.656593 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 227/436] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Nov 22 12:21:20 2021] POST /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21/action => generated 14 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 22 12:21:20.773156 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-cbb8cc59-0889-4410-ab6d-d4322e50765f tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1efac6c215148ce8c3ecdce1e9a8742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d392a7d77f46fcb4faa017786796fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:21:20.781105 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-cbb8cc59-0889-4410-ab6d-d4322e50765f tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] 10.222.0.66 "GET /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d" status: 200 len: 1521 microversion: 2.1 time: 0.164472 Nov 22 12:21:20.790755 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 210/437] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:21:20 2021] GET /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:21:20.790925 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-564516a4-bdfa-4a7b-a094-18ca6469b606 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:21:20.790925 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-564516a4-bdfa-4a7b-a094-18ca6469b606 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: c9f6d441-246f-479e-8e88-ea701c0f87ff] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:20.795157 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-564516a4-bdfa-4a7b-a094-18ca6469b606 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:20.795726 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-564516a4-bdfa-4a7b-a094-18ca6469b606 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:20.796688 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-564516a4-bdfa-4a7b-a094-18ca6469b606 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:20.797376 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-564516a4-bdfa-4a7b-a094-18ca6469b606 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:20.909359 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-564516a4-bdfa-4a7b-a094-18ca6469b606 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "POST /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff/action" status: 200 len: 33245 microversion: 2.20 time: 0.126941 Nov 22 12:21:20.910012 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 228/438] 10.222.0.66 () {62 vars in 1318 bytes} [Mon Nov 22 12:21:20 2021] POST /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff/action => generated 33245 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 12:21:21.113176 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-69f168d1-ed8b-46e4-a8ec-b2a0b4e8f68b tempest-VolumesNegativeTest-1241195036 tempest-VolumesNegativeTest-1241195036-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:21:21.113998 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-69f168d1-ed8b-46e4-a8ec-b2a0b4e8f68b tempest-VolumesNegativeTest-1241195036 tempest-VolumesNegativeTest-1241195036-project] [instance: 185570a5-ac44-4263-bf37-09b34256de29] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:21.120645 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-69f168d1-ed8b-46e4-a8ec-b2a0b4e8f68b tempest-VolumesNegativeTest-1241195036 tempest-VolumesNegativeTest-1241195036-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:21.121095 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-69f168d1-ed8b-46e4-a8ec-b2a0b4e8f68b tempest-VolumesNegativeTest-1241195036 tempest-VolumesNegativeTest-1241195036-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:21.121898 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-69f168d1-ed8b-46e4-a8ec-b2a0b4e8f68b tempest-VolumesNegativeTest-1241195036 tempest-VolumesNegativeTest-1241195036-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:21.122337 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-69f168d1-ed8b-46e4-a8ec-b2a0b4e8f68b tempest-VolumesNegativeTest-1241195036 tempest-VolumesNegativeTest-1241195036-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:21.135918 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.wsgi [None req-69f168d1-ed8b-46e4-a8ec-b2a0b4e8f68b tempest-VolumesNegativeTest-1241195036 tempest-VolumesNegativeTest-1241195036-project] HTTP exception thrown: Instance 185570a5-ac44-4263-bf37-09b34256de29 could not be found. Nov 22 12:21:21.136488 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-69f168d1-ed8b-46e4-a8ec-b2a0b4e8f68b tempest-VolumesNegativeTest-1241195036 tempest-VolumesNegativeTest-1241195036-project] Returning 404 to user: Instance 185570a5-ac44-4263-bf37-09b34256de29 could not be found. {{(pid=116273) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 12:21:21.137372 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-69f168d1-ed8b-46e4-a8ec-b2a0b4e8f68b tempest-VolumesNegativeTest-1241195036 tempest-VolumesNegativeTest-1241195036-project] 10.222.0.66 "GET /compute/v2.1/servers/185570a5-ac44-4263-bf37-09b34256de29" status: 404 len: 111 microversion: 2.1 time: 0.028160 Nov 22 12:21:21.138136 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 211/439] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:21:21 2021] GET /compute/v2.1/servers/185570a5-ac44-4263-bf37-09b34256de29 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 22 12:21:21.596930 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-e19b043e-79e0-4f0c-bd47-7a846b78dbff tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:21:21.598364 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-e19b043e-79e0-4f0c-bd47-7a846b78dbff tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] [instance: c30dcb83-017d-4428-9150-b68e8835ca64] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:21.606076 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-e19b043e-79e0-4f0c-bd47-7a846b78dbff tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:21.606544 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-e19b043e-79e0-4f0c-bd47-7a846b78dbff tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:21.607370 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-e19b043e-79e0-4f0c-bd47-7a846b78dbff tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:21.607805 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-e19b043e-79e0-4f0c-bd47-7a846b78dbff tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:21.666687 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-1cb8dcd3-8411-4911-ae55-48f9e20533e6 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:21:21.667834 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-1cb8dcd3-8411-4911-ae55-48f9e20533e6 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: 2306113c-8f98-42fd-8c0c-3dfac98fff21] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:21.676029 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-1cb8dcd3-8411-4911-ae55-48f9e20533e6 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:21.676631 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-1cb8dcd3-8411-4911-ae55-48f9e20533e6 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:21.677771 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-1cb8dcd3-8411-4911-ae55-48f9e20533e6 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:21.678249 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-1cb8dcd3-8411-4911-ae55-48f9e20533e6 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:21.756430 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-e19b043e-79e0-4f0c-bd47-7a846b78dbff tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8989f156c213442795edd8b9195bcbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad46aac0327b4760bef46d579031abd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:21:21.765767 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-e19b043e-79e0-4f0c-bd47-7a846b78dbff tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] 10.222.0.66 "GET /compute/v2.1/servers/c30dcb83-017d-4428-9150-b68e8835ca64" status: 200 len: 1314 microversion: 2.1 time: 0.178679 Nov 22 12:21:21.766533 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 229/440] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:21:21 2021] GET /compute/v2.1/servers/c30dcb83-017d-4428-9150-b68e8835ca64 => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:21:21.797591 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-2fb66385-89bf-4693-bae8-5f671bd0df84 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:21:21.798218 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-2fb66385-89bf-4693-bae8-5f671bd0df84 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] [instance: 302ab8ef-5565-4f9b-9b91-b405d550a90d] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:21.804767 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-2fb66385-89bf-4693-bae8-5f671bd0df84 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:21.805213 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-2fb66385-89bf-4693-bae8-5f671bd0df84 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:21.805942 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-2fb66385-89bf-4693-bae8-5f671bd0df84 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:21.806385 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-2fb66385-89bf-4693-bae8-5f671bd0df84 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:21.847649 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-1cb8dcd3-8411-4911-ae55-48f9e20533e6 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "POST /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21/action" status: 200 len: 4219 microversion: 2.1 time: 0.185225 Nov 22 12:21:21.848536 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 212/441] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Nov 22 12:21:21 2021] POST /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21/action => generated 4219 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:21:21.922019 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-85fe5efc-dfb8-44eb-8f39-1a67627a7b6a tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:21:21.923257 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-85fe5efc-dfb8-44eb-8f39-1a67627a7b6a tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: c9f6d441-246f-479e-8e88-ea701c0f87ff] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:21.930358 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-85fe5efc-dfb8-44eb-8f39-1a67627a7b6a tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:21.930803 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-85fe5efc-dfb8-44eb-8f39-1a67627a7b6a tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:21.931801 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-85fe5efc-dfb8-44eb-8f39-1a67627a7b6a tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:21.932227 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-85fe5efc-dfb8-44eb-8f39-1a67627a7b6a tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:21.956367 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-2fb66385-89bf-4693-bae8-5f671bd0df84 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1efac6c215148ce8c3ecdce1e9a8742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d392a7d77f46fcb4faa017786796fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:21:21.964324 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-2fb66385-89bf-4693-bae8-5f671bd0df84 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] 10.222.0.66 "GET /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d" status: 200 len: 1521 microversion: 2.1 time: 0.170347 Nov 22 12:21:21.964980 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 230/442] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:21:21 2021] GET /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 12:21:22.096818 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-85fe5efc-dfb8-44eb-8f39-1a67627a7b6a tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "POST /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff/action" status: 200 len: 33457 microversion: 2.20 time: 0.179097 Nov 22 12:21:22.097757 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 213/443] 10.222.0.66 () {62 vars in 1318 bytes} [Mon Nov 22 12:21:21 2021] POST /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff/action => generated 33457 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 22 12:21:22.783745 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-f5b2cb6b-6777-4367-8536-1e5f03015f46 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:21:22.784406 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-f5b2cb6b-6777-4367-8536-1e5f03015f46 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] [instance: c30dcb83-017d-4428-9150-b68e8835ca64] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:22.791442 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-f5b2cb6b-6777-4367-8536-1e5f03015f46 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:22.791894 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-f5b2cb6b-6777-4367-8536-1e5f03015f46 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:22.792667 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-f5b2cb6b-6777-4367-8536-1e5f03015f46 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:22.793093 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-f5b2cb6b-6777-4367-8536-1e5f03015f46 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:22.858594 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-54e7625d-3a73-44ca-8a45-e8653b66c697 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:21:22.859868 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-54e7625d-3a73-44ca-8a45-e8653b66c697 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: 2306113c-8f98-42fd-8c0c-3dfac98fff21] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:22.866935 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-54e7625d-3a73-44ca-8a45-e8653b66c697 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:22.868656 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-54e7625d-3a73-44ca-8a45-e8653b66c697 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:22.868656 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-54e7625d-3a73-44ca-8a45-e8653b66c697 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:22.869873 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-54e7625d-3a73-44ca-8a45-e8653b66c697 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:22.952755 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-f5b2cb6b-6777-4367-8536-1e5f03015f46 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8989f156c213442795edd8b9195bcbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad46aac0327b4760bef46d579031abd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:21:22.960790 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-f5b2cb6b-6777-4367-8536-1e5f03015f46 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] 10.222.0.66 "GET /compute/v2.1/servers/c30dcb83-017d-4428-9150-b68e8835ca64" status: 200 len: 1498 microversion: 2.1 time: 0.181216 Nov 22 12:21:22.961405 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 231/444] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:21:22 2021] GET /compute/v2.1/servers/c30dcb83-017d-4428-9150-b68e8835ca64 => generated 1498 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:21:22.982358 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-12cf21ba-5c5b-4466-a4fd-5e162d75987c tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:21:22.983083 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-12cf21ba-5c5b-4466-a4fd-5e162d75987c tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] [instance: 302ab8ef-5565-4f9b-9b91-b405d550a90d] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:22.989498 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-12cf21ba-5c5b-4466-a4fd-5e162d75987c tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:22.989941 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-12cf21ba-5c5b-4466-a4fd-5e162d75987c tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:22.990762 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-12cf21ba-5c5b-4466-a4fd-5e162d75987c tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:22.991188 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-12cf21ba-5c5b-4466-a4fd-5e162d75987c tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:23.005008 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-54e7625d-3a73-44ca-8a45-e8653b66c697 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "POST /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21/action" status: 200 len: 6451 microversion: 2.1 time: 0.149743 Nov 22 12:21:23.006576 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 214/445] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Nov 22 12:21:22 2021] POST /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21/action => generated 6451 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 12:21:23.110102 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-a21cecd7-88c5-4347-8083-8ad7c8620fff tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:21:23.111871 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-a21cecd7-88c5-4347-8083-8ad7c8620fff tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: c9f6d441-246f-479e-8e88-ea701c0f87ff] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:23.120733 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-a21cecd7-88c5-4347-8083-8ad7c8620fff tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:23.121475 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-a21cecd7-88c5-4347-8083-8ad7c8620fff tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:23.122498 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-a21cecd7-88c5-4347-8083-8ad7c8620fff tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:23.123285 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-a21cecd7-88c5-4347-8083-8ad7c8620fff tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:23.146040 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-12cf21ba-5c5b-4466-a4fd-5e162d75987c tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1efac6c215148ce8c3ecdce1e9a8742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d392a7d77f46fcb4faa017786796fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:21:23.156750 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-12cf21ba-5c5b-4466-a4fd-5e162d75987c tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] 10.222.0.66 "GET /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d" status: 200 len: 1521 microversion: 2.1 time: 0.178024 Nov 22 12:21:23.157331 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 232/446] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:21:22 2021] GET /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d => generated 1521 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 12:21:23.285068 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-a21cecd7-88c5-4347-8083-8ad7c8620fff tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "POST /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff/action" status: 200 len: 33688 microversion: 2.20 time: 0.179492 Nov 22 12:21:23.285814 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 215/447] 10.222.0.66 () {62 vars in 1318 bytes} [Mon Nov 22 12:21:23 2021] POST /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff/action => generated 33688 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 12:21:23.724859 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-ef04e181-7862-4cb1-b333-56c08c804a7d tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:21:23.725835 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-ef04e181-7862-4cb1-b333-56c08c804a7d tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] [instance: c30dcb83-017d-4428-9150-b68e8835ca64] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:23.732878 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-ef04e181-7862-4cb1-b333-56c08c804a7d tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:23.733322 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-ef04e181-7862-4cb1-b333-56c08c804a7d tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:23.734184 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-ef04e181-7862-4cb1-b333-56c08c804a7d tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:23.734610 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-ef04e181-7862-4cb1-b333-56c08c804a7d tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:23.760661 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-ef04e181-7862-4cb1-b333-56c08c804a7d tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] [instance: c30dcb83-017d-4428-9150-b68e8835ca64] Going to try to terminate instance {{(pid=116272) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 22 12:21:23.845609 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-ef04e181-7862-4cb1-b333-56c08c804a7d tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] 10.222.0.66 "DELETE /compute/v2.1/servers/c30dcb83-017d-4428-9150-b68e8835ca64" status: 204 len: 0 microversion: 2.1 time: 0.124470 Nov 22 12:21:23.846303 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 233/448] 10.222.0.66 () {58 vars in 1238 bytes} [Mon Nov 22 12:21:23 2021] DELETE /compute/v2.1/servers/c30dcb83-017d-4428-9150-b68e8835ca64 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 22 12:21:23.858730 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-987d4180-9da7-4ad4-adf2-17a8c5018315 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:21:23.859503 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-987d4180-9da7-4ad4-adf2-17a8c5018315 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] [instance: c30dcb83-017d-4428-9150-b68e8835ca64] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:23.867426 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-987d4180-9da7-4ad4-adf2-17a8c5018315 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:23.867426 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-987d4180-9da7-4ad4-adf2-17a8c5018315 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:23.868224 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-987d4180-9da7-4ad4-adf2-17a8c5018315 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:23.868739 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-987d4180-9da7-4ad4-adf2-17a8c5018315 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:24.013982 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-987d4180-9da7-4ad4-adf2-17a8c5018315 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8989f156c213442795edd8b9195bcbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad46aac0327b4760bef46d579031abd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:21:24.019786 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-9002c0b8-b669-4212-92b2-f9cde2e72abe tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:21:24.020970 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-9002c0b8-b669-4212-92b2-f9cde2e72abe tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: 2306113c-8f98-42fd-8c0c-3dfac98fff21] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:24.022446 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-987d4180-9da7-4ad4-adf2-17a8c5018315 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] 10.222.0.66 "GET /compute/v2.1/servers/c30dcb83-017d-4428-9150-b68e8835ca64" status: 200 len: 1504 microversion: 2.1 time: 0.167776 Nov 22 12:21:24.023271 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 216/449] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:21:23 2021] GET /compute/v2.1/servers/c30dcb83-017d-4428-9150-b68e8835ca64 => generated 1504 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:21:24.028641 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-9002c0b8-b669-4212-92b2-f9cde2e72abe tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:24.029337 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-9002c0b8-b669-4212-92b2-f9cde2e72abe tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:24.030277 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-9002c0b8-b669-4212-92b2-f9cde2e72abe tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:24.031074 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-9002c0b8-b669-4212-92b2-f9cde2e72abe tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:24.174224 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-bbc0d77f-5351-40aa-9dca-5f0c2d814712 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:21:24.174734 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-bbc0d77f-5351-40aa-9dca-5f0c2d814712 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] [instance: 302ab8ef-5565-4f9b-9b91-b405d550a90d] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:24.181709 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-bbc0d77f-5351-40aa-9dca-5f0c2d814712 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:24.182170 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-bbc0d77f-5351-40aa-9dca-5f0c2d814712 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:24.182954 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-bbc0d77f-5351-40aa-9dca-5f0c2d814712 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:24.183432 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-bbc0d77f-5351-40aa-9dca-5f0c2d814712 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:24.202965 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-9002c0b8-b669-4212-92b2-f9cde2e72abe tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "POST /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21/action" status: 200 len: 7546 microversion: 2.1 time: 0.187258 Nov 22 12:21:24.203656 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 234/450] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Nov 22 12:21:24 2021] POST /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21/action => generated 7546 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 12:21:24.308372 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-b85afd9a-ddd9-499c-af54-6bc9acd79557 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:21:24.310079 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-b85afd9a-ddd9-499c-af54-6bc9acd79557 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: c9f6d441-246f-479e-8e88-ea701c0f87ff] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:24.318517 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-b85afd9a-ddd9-499c-af54-6bc9acd79557 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:24.318965 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-b85afd9a-ddd9-499c-af54-6bc9acd79557 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:24.319772 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-b85afd9a-ddd9-499c-af54-6bc9acd79557 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:24.320210 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-b85afd9a-ddd9-499c-af54-6bc9acd79557 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:24.322034 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-bbc0d77f-5351-40aa-9dca-5f0c2d814712 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1efac6c215148ce8c3ecdce1e9a8742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d392a7d77f46fcb4faa017786796fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:21:24.330039 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-bbc0d77f-5351-40aa-9dca-5f0c2d814712 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] 10.222.0.66 "GET /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d" status: 200 len: 1521 microversion: 2.1 time: 0.159840 Nov 22 12:21:24.330690 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 217/451] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:21:24 2021] GET /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:21:24.462556 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-b85afd9a-ddd9-499c-af54-6bc9acd79557 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "POST /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff/action" status: 200 len: 34081 microversion: 2.20 time: 0.167370 Nov 22 12:21:24.463122 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 235/452] 10.222.0.66 () {62 vars in 1318 bytes} [Mon Nov 22 12:21:24 2021] POST /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff/action => generated 34081 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 12:21:25.042288 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-e0e273ef-cb45-48bf-bc1b-1860fbf2e689 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:21:25.042907 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-e0e273ef-cb45-48bf-bc1b-1860fbf2e689 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] [instance: c30dcb83-017d-4428-9150-b68e8835ca64] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:25.052077 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-e0e273ef-cb45-48bf-bc1b-1860fbf2e689 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:25.052611 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-e0e273ef-cb45-48bf-bc1b-1860fbf2e689 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:25.053698 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-e0e273ef-cb45-48bf-bc1b-1860fbf2e689 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:25.054148 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-e0e273ef-cb45-48bf-bc1b-1860fbf2e689 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:25.198110 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-e0e273ef-cb45-48bf-bc1b-1860fbf2e689 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8989f156c213442795edd8b9195bcbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad46aac0327b4760bef46d579031abd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:21:25.205839 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-e0e273ef-cb45-48bf-bc1b-1860fbf2e689 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] 10.222.0.66 "GET /compute/v2.1/servers/c30dcb83-017d-4428-9150-b68e8835ca64" status: 200 len: 1504 microversion: 2.1 time: 0.169938 Nov 22 12:21:25.206434 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 218/453] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:21:25 2021] GET /compute/v2.1/servers/c30dcb83-017d-4428-9150-b68e8835ca64 => generated 1504 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:21:25.216323 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-60145135-dd81-42d3-aa5c-2c8c74aedec1 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:21:25.217356 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-60145135-dd81-42d3-aa5c-2c8c74aedec1 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: 2306113c-8f98-42fd-8c0c-3dfac98fff21] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:25.224885 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-60145135-dd81-42d3-aa5c-2c8c74aedec1 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:25.225414 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-60145135-dd81-42d3-aa5c-2c8c74aedec1 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:25.226267 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-60145135-dd81-42d3-aa5c-2c8c74aedec1 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:25.226720 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-60145135-dd81-42d3-aa5c-2c8c74aedec1 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:25.347600 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-cee18a5d-2fb1-4c04-aa5d-4b3111d8e5cc tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:21:25.348205 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-cee18a5d-2fb1-4c04-aa5d-4b3111d8e5cc tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] [instance: 302ab8ef-5565-4f9b-9b91-b405d550a90d] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:25.354570 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-cee18a5d-2fb1-4c04-aa5d-4b3111d8e5cc tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:25.355141 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-cee18a5d-2fb1-4c04-aa5d-4b3111d8e5cc tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:25.356250 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-cee18a5d-2fb1-4c04-aa5d-4b3111d8e5cc tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:25.356785 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-cee18a5d-2fb1-4c04-aa5d-4b3111d8e5cc tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:25.369833 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-60145135-dd81-42d3-aa5c-2c8c74aedec1 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "POST /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21/action" status: 200 len: 9954 microversion: 2.1 time: 0.157091 Nov 22 12:21:25.371354 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 236/454] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Nov 22 12:21:25 2021] POST /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21/action => generated 9954 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:21:25.475954 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-b221c517-3788-47f0-ba0e-7ba6b8f5645d tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:21:25.477278 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-b221c517-3788-47f0-ba0e-7ba6b8f5645d tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: c9f6d441-246f-479e-8e88-ea701c0f87ff] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:25.492584 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-b221c517-3788-47f0-ba0e-7ba6b8f5645d tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:25.493115 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-b221c517-3788-47f0-ba0e-7ba6b8f5645d tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:25.493994 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-b221c517-3788-47f0-ba0e-7ba6b8f5645d tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:25.494518 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-b221c517-3788-47f0-ba0e-7ba6b8f5645d tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:25.529121 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-cee18a5d-2fb1-4c04-aa5d-4b3111d8e5cc tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1efac6c215148ce8c3ecdce1e9a8742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d392a7d77f46fcb4faa017786796fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:21:25.537290 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-cee18a5d-2fb1-4c04-aa5d-4b3111d8e5cc tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] 10.222.0.66 "GET /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d" status: 200 len: 1501 microversion: 2.1 time: 0.193374 Nov 22 12:21:25.538086 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 219/455] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:21:25 2021] GET /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d => generated 1501 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 12:21:25.554200 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-a45933bc-d86d-4699-a514-2c4b8e98b2fc tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d443517b-84c7-4916-8eca-1bad8452506d"}} {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:21:25.555276 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-a45933bc-d86d-4699-a514-2c4b8e98b2fc tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] [instance: 302ab8ef-5565-4f9b-9b91-b405d550a90d] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:25.561867 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-a45933bc-d86d-4699-a514-2c4b8e98b2fc tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:25.562637 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-a45933bc-d86d-4699-a514-2c4b8e98b2fc tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:25.563480 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-a45933bc-d86d-4699-a514-2c4b8e98b2fc tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:25.563889 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-a45933bc-d86d-4699-a514-2c4b8e98b2fc tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:25.588065 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.wsgi [None req-a45933bc-d86d-4699-a514-2c4b8e98b2fc tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] HTTP exception thrown: Cannot 'attach_volume' instance 302ab8ef-5565-4f9b-9b91-b405d550a90d while it is in vm_state rescued Nov 22 12:21:25.588576 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-a45933bc-d86d-4699-a514-2c4b8e98b2fc tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Returning 409 to user: Cannot 'attach_volume' instance 302ab8ef-5565-4f9b-9b91-b405d550a90d while it is in vm_state rescued {{(pid=116273) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 12:21:25.589395 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-a45933bc-d86d-4699-a514-2c4b8e98b2fc tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] 10.222.0.66 "POST /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.038980 Nov 22 12:21:25.589941 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 220/456] 10.222.0.66 () {60 vars in 1322 bytes} [Mon Nov 22 12:21:25 2021] POST /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d/os-volume_attachments => generated 152 bytes in 40 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Nov 22 12:21:25.598662 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-b3bdc625-f664-408b-8548-2f129ef17253 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:21:25.599191 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-b3bdc625-f664-408b-8548-2f129ef17253 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] [instance: 302ab8ef-5565-4f9b-9b91-b405d550a90d] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:25.606480 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-b3bdc625-f664-408b-8548-2f129ef17253 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:25.607026 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-b3bdc625-f664-408b-8548-2f129ef17253 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:25.607986 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-b3bdc625-f664-408b-8548-2f129ef17253 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:25.608560 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-b3bdc625-f664-408b-8548-2f129ef17253 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:25.629294 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-b221c517-3788-47f0-ba0e-7ba6b8f5645d tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "POST /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff/action" status: 200 len: 34527 microversion: 2.20 time: 0.156885 Nov 22 12:21:25.630480 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 237/457] 10.222.0.66 () {62 vars in 1318 bytes} [Mon Nov 22 12:21:25 2021] POST /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff/action => generated 34527 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 12:21:25.696341 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-b3bdc625-f664-408b-8548-2f129ef17253 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] 10.222.0.66 "POST /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d/action" status: 202 len: 0 microversion: 2.1 time: 0.100492 Nov 22 12:21:25.697282 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 221/458] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Nov 22 12:21:25 2021] POST /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d/action => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 22 12:21:25.706073 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-f7c98d58-182c-4124-9434-4ea1d080cf89 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:21:25.706776 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-f7c98d58-182c-4124-9434-4ea1d080cf89 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] [instance: 302ab8ef-5565-4f9b-9b91-b405d550a90d] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:25.714553 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-f7c98d58-182c-4124-9434-4ea1d080cf89 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:25.714999 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-f7c98d58-182c-4124-9434-4ea1d080cf89 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:25.716018 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-f7c98d58-182c-4124-9434-4ea1d080cf89 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:25.716646 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-f7c98d58-182c-4124-9434-4ea1d080cf89 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:25.872546 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-f7c98d58-182c-4124-9434-4ea1d080cf89 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1efac6c215148ce8c3ecdce1e9a8742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d392a7d77f46fcb4faa017786796fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:21:25.881665 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-f7c98d58-182c-4124-9434-4ea1d080cf89 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] 10.222.0.66 "GET /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d" status: 200 len: 1509 microversion: 2.1 time: 0.179780 Nov 22 12:21:25.882336 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 238/459] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:21:25 2021] GET /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d => generated 1509 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:21:26.224366 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-cf8bc100-1430-4f82-afaf-2e12a2cc47bc tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:21:26.226127 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-cf8bc100-1430-4f82-afaf-2e12a2cc47bc tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] [instance: c30dcb83-017d-4428-9150-b68e8835ca64] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:26.232867 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-cf8bc100-1430-4f82-afaf-2e12a2cc47bc tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:26.233410 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-cf8bc100-1430-4f82-afaf-2e12a2cc47bc tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:26.234212 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-cf8bc100-1430-4f82-afaf-2e12a2cc47bc tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:26.234642 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-cf8bc100-1430-4f82-afaf-2e12a2cc47bc tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:26.379777 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-cf8bc100-1430-4f82-afaf-2e12a2cc47bc tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8989f156c213442795edd8b9195bcbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad46aac0327b4760bef46d579031abd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:21:26.383270 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-a1e55beb-2549-4a7c-9ff2-9c37dff949b2 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:21:26.384905 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-a1e55beb-2549-4a7c-9ff2-9c37dff949b2 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: 2306113c-8f98-42fd-8c0c-3dfac98fff21] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:26.387408 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-cf8bc100-1430-4f82-afaf-2e12a2cc47bc tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] 10.222.0.66 "GET /compute/v2.1/servers/c30dcb83-017d-4428-9150-b68e8835ca64" status: 200 len: 1504 microversion: 2.1 time: 0.167140 Nov 22 12:21:26.396148 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-a1e55beb-2549-4a7c-9ff2-9c37dff949b2 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:26.396857 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-a1e55beb-2549-4a7c-9ff2-9c37dff949b2 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:26.397578 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 222/460] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:21:26 2021] GET /compute/v2.1/servers/c30dcb83-017d-4428-9150-b68e8835ca64 => generated 1504 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 12:21:26.398057 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-a1e55beb-2549-4a7c-9ff2-9c37dff949b2 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:26.398682 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-a1e55beb-2549-4a7c-9ff2-9c37dff949b2 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:26.566675 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-a1e55beb-2549-4a7c-9ff2-9c37dff949b2 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "POST /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21/action" status: 200 len: 11817 microversion: 2.1 time: 0.187729 Nov 22 12:21:26.567475 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 239/461] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Nov 22 12:21:26 2021] POST /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21/action => generated 11817 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 22 12:21:26.648384 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-b3bd2f5b-f1bc-490e-bcf9-e5318757c80e tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:21:26.652093 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-b3bd2f5b-f1bc-490e-bcf9-e5318757c80e tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: c9f6d441-246f-479e-8e88-ea701c0f87ff] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:26.658455 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-b3bd2f5b-f1bc-490e-bcf9-e5318757c80e tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:26.658900 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-b3bd2f5b-f1bc-490e-bcf9-e5318757c80e tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:26.659980 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-b3bd2f5b-f1bc-490e-bcf9-e5318757c80e tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:26.660423 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-b3bd2f5b-f1bc-490e-bcf9-e5318757c80e tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:26.869811 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-b3bd2f5b-f1bc-490e-bcf9-e5318757c80e tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "POST /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff/action" status: 200 len: 34927 microversion: 2.20 time: 0.232010 Nov 22 12:21:26.870530 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 223/462] 10.222.0.66 () {62 vars in 1318 bytes} [Mon Nov 22 12:21:26 2021] POST /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff/action => generated 34927 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 22 12:21:26.900307 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-f95f1f91-2126-4f0d-b44c-2bd5ea712c45 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:21:26.901030 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-f95f1f91-2126-4f0d-b44c-2bd5ea712c45 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] [instance: 302ab8ef-5565-4f9b-9b91-b405d550a90d] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:26.908403 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-f95f1f91-2126-4f0d-b44c-2bd5ea712c45 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:26.908846 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-f95f1f91-2126-4f0d-b44c-2bd5ea712c45 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:26.909644 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-f95f1f91-2126-4f0d-b44c-2bd5ea712c45 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:26.910072 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-f95f1f91-2126-4f0d-b44c-2bd5ea712c45 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:27.044251 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-f95f1f91-2126-4f0d-b44c-2bd5ea712c45 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1efac6c215148ce8c3ecdce1e9a8742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d392a7d77f46fcb4faa017786796fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:21:27.053755 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-f95f1f91-2126-4f0d-b44c-2bd5ea712c45 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] 10.222.0.66 "GET /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d" status: 200 len: 1509 microversion: 2.1 time: 0.157362 Nov 22 12:21:27.054529 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 240/463] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:21:26 2021] GET /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d => generated 1509 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:21:27.156115 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-cc9649d2-8ef2-484e-89f1-6d0e406fd8d2 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dad3ebba-64a3-4336-af82-17fd065353db", "device": "/dev/sdb"}} {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:21:27.158041 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-cc9649d2-8ef2-484e-89f1-6d0e406fd8d2 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] [instance: a3624677-f35c-4a8c-ad79-990ee6987c7b] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:27.165224 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-cc9649d2-8ef2-484e-89f1-6d0e406fd8d2 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:27.165895 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-cc9649d2-8ef2-484e-89f1-6d0e406fd8d2 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:27.166851 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-cc9649d2-8ef2-484e-89f1-6d0e406fd8d2 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:27.167305 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-cc9649d2-8ef2-484e-89f1-6d0e406fd8d2 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:27.406355 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-799f71c3-b118-4de4-b5aa-3e7dffd08d17 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:21:27.407998 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-799f71c3-b118-4de4-b5aa-3e7dffd08d17 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] [instance: c30dcb83-017d-4428-9150-b68e8835ca64] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:27.429528 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-799f71c3-b118-4de4-b5aa-3e7dffd08d17 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:27.431119 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-799f71c3-b118-4de4-b5aa-3e7dffd08d17 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:27.434021 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-799f71c3-b118-4de4-b5aa-3e7dffd08d17 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:27.436659 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-799f71c3-b118-4de4-b5aa-3e7dffd08d17 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:27.481696 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-cc9649d2-8ef2-484e-89f1-6d0e406fd8d2 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] 10.222.0.66 "POST /compute/v2.1/servers/a3624677-f35c-4a8c-ad79-990ee6987c7b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.328858 Nov 22 12:21:27.484712 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 224/464] 10.222.0.66 () {60 vars in 1322 bytes} [Mon Nov 22 12:21:27 2021] POST /compute/v2.1/servers/a3624677-f35c-4a8c-ad79-990ee6987c7b/os-volume_attachments => generated 194 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 12:21:27.581408 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-27029830-486b-45a6-a033-aad6c3927c8c tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:21:27.582727 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-27029830-486b-45a6-a033-aad6c3927c8c tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: 2306113c-8f98-42fd-8c0c-3dfac98fff21] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:27.621736 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-27029830-486b-45a6-a033-aad6c3927c8c tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:27.622183 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-27029830-486b-45a6-a033-aad6c3927c8c tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:27.623143 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-27029830-486b-45a6-a033-aad6c3927c8c tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:27.623652 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-27029830-486b-45a6-a033-aad6c3927c8c tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:27.767671 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-27029830-486b-45a6-a033-aad6c3927c8c tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "POST /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21/action" status: 200 len: 14522 microversion: 2.1 time: 0.192494 Nov 22 12:21:27.770905 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 225/465] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Nov 22 12:21:27 2021] POST /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21/action => generated 14522 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 22 12:21:27.799620 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-70b02633-1b19-4d40-9a4d-a058291a4519 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d845c8ca-b2bb-419f-a375-9dd7e913dfc6"}} {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:21:27.800757 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-70b02633-1b19-4d40-9a4d-a058291a4519 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] [instance: d457eff7-4539-4ee1-8c94-c51cd4b5b2c1] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:27.807823 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-70b02633-1b19-4d40-9a4d-a058291a4519 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:27.808268 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-70b02633-1b19-4d40-9a4d-a058291a4519 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:27.809062 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-70b02633-1b19-4d40-9a4d-a058291a4519 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:27.809491 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-70b02633-1b19-4d40-9a4d-a058291a4519 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:27.813003 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-799f71c3-b118-4de4-b5aa-3e7dffd08d17 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8989f156c213442795edd8b9195bcbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad46aac0327b4760bef46d579031abd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:21:27.822863 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-799f71c3-b118-4de4-b5aa-3e7dffd08d17 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] 10.222.0.66 "GET /compute/v2.1/servers/c30dcb83-017d-4428-9150-b68e8835ca64" status: 200 len: 1504 microversion: 2.1 time: 0.421618 Nov 22 12:21:27.833249 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 241/466] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:21:27 2021] GET /compute/v2.1/servers/c30dcb83-017d-4428-9150-b68e8835ca64 => generated 1504 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 12:21:27.883372 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-fff14730-5094-4bb4-b5d6-973ebc97bbab tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:21:27.884844 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-fff14730-5094-4bb4-b5d6-973ebc97bbab tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: c9f6d441-246f-479e-8e88-ea701c0f87ff] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:27.893071 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-fff14730-5094-4bb4-b5d6-973ebc97bbab tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:27.893442 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-fff14730-5094-4bb4-b5d6-973ebc97bbab tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:27.897527 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.wsgi [None req-70b02633-1b19-4d40-9a4d-a058291a4519 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] HTTP exception thrown: Invalid volume: volume d845c8ca-b2bb-419f-a375-9dd7e913dfc6 is already attached to instances: d457eff7-4539-4ee1-8c94-c51cd4b5b2c1 Nov 22 12:21:27.898123 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-70b02633-1b19-4d40-9a4d-a058291a4519 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Returning 400 to user: Invalid volume: volume d845c8ca-b2bb-419f-a375-9dd7e913dfc6 is already attached to instances: d457eff7-4539-4ee1-8c94-c51cd4b5b2c1 {{(pid=116273) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 12:21:27.898524 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-fff14730-5094-4bb4-b5d6-973ebc97bbab tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:27.899021 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-70b02633-1b19-4d40-9a4d-a058291a4519 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] 10.222.0.66 "POST /compute/v2.1/servers/d457eff7-4539-4ee1-8c94-c51cd4b5b2c1/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.103769 Nov 22 12:21:27.899393 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-fff14730-5094-4bb4-b5d6-973ebc97bbab tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:27.909998 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 226/467] 10.222.0.66 () {60 vars in 1322 bytes} [Mon Nov 22 12:21:27 2021] POST /compute/v2.1/servers/d457eff7-4539-4ee1-8c94-c51cd4b5b2c1/os-volume_attachments => generated 174 bytes in 108 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Nov 22 12:21:27.993924 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-647aef98-ac37-447e-b3c5-9c79f2909482 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:21:27.994703 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-647aef98-ac37-447e-b3c5-9c79f2909482 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] [instance: d457eff7-4539-4ee1-8c94-c51cd4b5b2c1] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:28.001851 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-647aef98-ac37-447e-b3c5-9c79f2909482 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:28.002598 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-647aef98-ac37-447e-b3c5-9c79f2909482 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:28.003437 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-647aef98-ac37-447e-b3c5-9c79f2909482 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:28.004017 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-647aef98-ac37-447e-b3c5-9c79f2909482 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:28.053024 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-fff14730-5094-4bb4-b5d6-973ebc97bbab tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "POST /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff/action" status: 200 len: 35239 microversion: 2.20 time: 0.174279 Nov 22 12:21:28.054477 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 242/468] 10.222.0.66 () {62 vars in 1318 bytes} [Mon Nov 22 12:21:27 2021] POST /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff/action => generated 35239 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 22 12:21:28.108549 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-4f046394-a56c-4911-b4c7-5e227832a7e5 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:21:28.109724 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-4f046394-a56c-4911-b4c7-5e227832a7e5 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] [instance: 302ab8ef-5565-4f9b-9b91-b405d550a90d] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:28.123382 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.objects.instance [None req-647aef98-ac37-447e-b3c5-9c79f2909482 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lazy-loading 'services' on Instance uuid d457eff7-4539-4ee1-8c94-c51cd4b5b2c1 {{(pid=116273) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 22 12:21:28.126999 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-4f046394-a56c-4911-b4c7-5e227832a7e5 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:28.128435 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-4f046394-a56c-4911-b4c7-5e227832a7e5 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:28.129383 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-4f046394-a56c-4911-b4c7-5e227832a7e5 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:28.129942 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-4f046394-a56c-4911-b4c7-5e227832a7e5 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:28.254998 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-647aef98-ac37-447e-b3c5-9c79f2909482 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] 10.222.0.66 "DELETE /compute/v2.1/servers/d457eff7-4539-4ee1-8c94-c51cd4b5b2c1/os-volume_attachments/d845c8ca-b2bb-419f-a375-9dd7e913dfc6" status: 202 len: 0 microversion: 2.1 time: 0.265262 Nov 22 12:21:28.255708 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 227/469] 10.222.0.66 () {58 vars in 1415 bytes} [Mon Nov 22 12:21:27 2021] DELETE /compute/v2.1/servers/d457eff7-4539-4ee1-8c94-c51cd4b5b2c1/os-volume_attachments/d845c8ca-b2bb-419f-a375-9dd7e913dfc6 => generated 0 bytes in 267 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 22 12:21:28.296627 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-ab03c4df-3ab9-4197-b1cf-35b32a2ab66f tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:21:28.298032 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-ab03c4df-3ab9-4197-b1cf-35b32a2ab66f tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] [instance: d457eff7-4539-4ee1-8c94-c51cd4b5b2c1] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:28.309189 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-ab03c4df-3ab9-4197-b1cf-35b32a2ab66f tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:28.310400 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-ab03c4df-3ab9-4197-b1cf-35b32a2ab66f tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:28.311842 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-ab03c4df-3ab9-4197-b1cf-35b32a2ab66f tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:28.313299 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-ab03c4df-3ab9-4197-b1cf-35b32a2ab66f tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:28.383285 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-ab03c4df-3ab9-4197-b1cf-35b32a2ab66f tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] 10.222.0.66 "GET /compute/v2.1/servers/d457eff7-4539-4ee1-8c94-c51cd4b5b2c1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.116362 Nov 22 12:21:28.384978 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 228/470] 10.222.0.66 () {58 vars in 1301 bytes} [Mon Nov 22 12:21:28 2021] GET /compute/v2.1/servers/d457eff7-4539-4ee1-8c94-c51cd4b5b2c1/os-volume_attachments => generated 197 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 12:21:28.555753 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-4f046394-a56c-4911-b4c7-5e227832a7e5 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1efac6c215148ce8c3ecdce1e9a8742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d392a7d77f46fcb4faa017786796fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:21:28.568228 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-4f046394-a56c-4911-b4c7-5e227832a7e5 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] 10.222.0.66 "GET /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d" status: 200 len: 1509 microversion: 2.1 time: 0.480435 Nov 22 12:21:28.569314 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 243/471] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:21:28 2021] GET /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d => generated 1509 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:21:28.781766 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-6d10de21-6d13-4594-9347-05f51e8dda98 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:21:28.783462 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-6d10de21-6d13-4594-9347-05f51e8dda98 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: 2306113c-8f98-42fd-8c0c-3dfac98fff21] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:28.792013 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-6d10de21-6d13-4594-9347-05f51e8dda98 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:28.792744 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-6d10de21-6d13-4594-9347-05f51e8dda98 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:28.793899 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-6d10de21-6d13-4594-9347-05f51e8dda98 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:28.794714 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-6d10de21-6d13-4594-9347-05f51e8dda98 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:28.814096 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [req-b841ef21-717c-4aaf-82ab-7d18c24f980c req-579fc497-34d6-4f2a-a132-e2444949502a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c30dcb83-017d-4428-9150-b68e8835ca64", "name": "network-vif-deleted", "tag": "0bbd7299-c83f-4a3c-bdea-4930e3bb6de3"}]} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:21:28.815750 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 12:21:28.815750 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: warnings.warn(msg) Nov 22 12:21:28.840638 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [req-b841ef21-717c-4aaf-82ab-7d18c24f980c req-579fc497-34d6-4f2a-a132-e2444949502a service nova] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:28.843073 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [req-b841ef21-717c-4aaf-82ab-7d18c24f980c req-579fc497-34d6-4f2a-a132-e2444949502a service nova] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:28.861710 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.compute.server_external_events [req-b841ef21-717c-4aaf-82ab-7d18c24f980c req-579fc497-34d6-4f2a-a132-e2444949502a service nova] Creating event network-vif-deleted:0bbd7299-c83f-4a3c-bdea-4930e3bb6de3 for instance c30dcb83-017d-4428-9150-b68e8835ca64 on hv-cinder-76845 Nov 22 12:21:28.867722 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [req-b841ef21-717c-4aaf-82ab-7d18c24f980c req-579fc497-34d6-4f2a-a132-e2444949502a service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057228 Nov 22 12:21:28.868694 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 244/472] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Nov 22 12:21:28 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 22 12:21:28.875166 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-f9b93482-a181-4d88-bad8-2d12763387ae tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:21:28.875833 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-f9b93482-a181-4d88-bad8-2d12763387ae tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] [instance: c30dcb83-017d-4428-9150-b68e8835ca64] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:28.882621 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-f9b93482-a181-4d88-bad8-2d12763387ae tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:28.883460 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-f9b93482-a181-4d88-bad8-2d12763387ae tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:28.884454 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-f9b93482-a181-4d88-bad8-2d12763387ae tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:28.885343 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-f9b93482-a181-4d88-bad8-2d12763387ae tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:28.917427 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-6d10de21-6d13-4594-9347-05f51e8dda98 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "POST /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21/action" status: 200 len: 16319 microversion: 2.1 time: 0.139652 Nov 22 12:21:28.923197 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 229/473] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Nov 22 12:21:28 2021] POST /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21/action => generated 16319 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 12:21:29.002568 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-f9b93482-a181-4d88-bad8-2d12763387ae tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8989f156c213442795edd8b9195bcbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad46aac0327b4760bef46d579031abd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:21:29.012499 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-f9b93482-a181-4d88-bad8-2d12763387ae tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] 10.222.0.66 "GET /compute/v2.1/servers/c30dcb83-017d-4428-9150-b68e8835ca64" status: 200 len: 1299 microversion: 2.1 time: 0.142453 Nov 22 12:21:29.014208 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 245/474] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:21:28 2021] GET /compute/v2.1/servers/c30dcb83-017d-4428-9150-b68e8835ca64 => generated 1299 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:21:29.070894 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-d97a264e-c2ad-4d59-b13d-27ce6e492c9b tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:21:29.072594 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-d97a264e-c2ad-4d59-b13d-27ce6e492c9b tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: c9f6d441-246f-479e-8e88-ea701c0f87ff] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:29.082457 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-d97a264e-c2ad-4d59-b13d-27ce6e492c9b tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:29.083807 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-d97a264e-c2ad-4d59-b13d-27ce6e492c9b tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:29.085956 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-d97a264e-c2ad-4d59-b13d-27ce6e492c9b tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:29.086594 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-d97a264e-c2ad-4d59-b13d-27ce6e492c9b tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:29.215417 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-d97a264e-c2ad-4d59-b13d-27ce6e492c9b tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "POST /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff/action" status: 200 len: 36183 microversion: 2.20 time: 0.149120 Nov 22 12:21:29.216320 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 230/475] 10.222.0.66 () {62 vars in 1318 bytes} [Mon Nov 22 12:21:29 2021] POST /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff/action => generated 36183 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 12:21:29.397016 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-6a44f340-a2c7-44f2-bf0a-09889532be70 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:21:29.397931 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-6a44f340-a2c7-44f2-bf0a-09889532be70 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] [instance: d457eff7-4539-4ee1-8c94-c51cd4b5b2c1] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:29.404423 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-6a44f340-a2c7-44f2-bf0a-09889532be70 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:29.405274 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-6a44f340-a2c7-44f2-bf0a-09889532be70 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:29.406256 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-6a44f340-a2c7-44f2-bf0a-09889532be70 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:29.406864 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-6a44f340-a2c7-44f2-bf0a-09889532be70 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:29.446782 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-6a44f340-a2c7-44f2-bf0a-09889532be70 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] 10.222.0.66 "GET /compute/v2.1/servers/d457eff7-4539-4ee1-8c94-c51cd4b5b2c1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053780 Nov 22 12:21:29.447612 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 246/476] 10.222.0.66 () {58 vars in 1301 bytes} [Mon Nov 22 12:21:29 2021] GET /compute/v2.1/servers/d457eff7-4539-4ee1-8c94-c51cd4b5b2c1/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 12:21:29.592303 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-cc5fc84d-dee0-496b-882d-9767a5ba5d9e tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:21:29.593290 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-cc5fc84d-dee0-496b-882d-9767a5ba5d9e tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] [instance: 302ab8ef-5565-4f9b-9b91-b405d550a90d] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:29.600556 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-cc5fc84d-dee0-496b-882d-9767a5ba5d9e tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:29.601373 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-cc5fc84d-dee0-496b-882d-9767a5ba5d9e tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:29.602328 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-cc5fc84d-dee0-496b-882d-9767a5ba5d9e tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:29.602933 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-cc5fc84d-dee0-496b-882d-9767a5ba5d9e tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:29.893724 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-cc5fc84d-dee0-496b-882d-9767a5ba5d9e tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1efac6c215148ce8c3ecdce1e9a8742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d392a7d77f46fcb4faa017786796fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:21:29.904077 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-cc5fc84d-dee0-496b-882d-9767a5ba5d9e tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] 10.222.0.66 "GET /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d" status: 200 len: 1509 microversion: 2.1 time: 0.321708 Nov 22 12:21:29.916222 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 231/477] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:21:29 2021] GET /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d => generated 1509 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:21:29.929841 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-e6f64528-2089-4775-9044-433084684d07 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:21:29.930916 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-e6f64528-2089-4775-9044-433084684d07 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: 2306113c-8f98-42fd-8c0c-3dfac98fff21] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:29.939154 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-e6f64528-2089-4775-9044-433084684d07 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:29.940286 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-e6f64528-2089-4775-9044-433084684d07 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:29.944305 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-e6f64528-2089-4775-9044-433084684d07 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:29.945097 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-e6f64528-2089-4775-9044-433084684d07 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:30.030795 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-1506844c-9361-4d10-9c51-4515e04cd68d tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:21:30.031465 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-1506844c-9361-4d10-9c51-4515e04cd68d tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] [instance: c30dcb83-017d-4428-9150-b68e8835ca64] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:30.038023 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-1506844c-9361-4d10-9c51-4515e04cd68d tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:30.039198 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-1506844c-9361-4d10-9c51-4515e04cd68d tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:30.040043 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-1506844c-9361-4d10-9c51-4515e04cd68d tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:30.040487 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-1506844c-9361-4d10-9c51-4515e04cd68d tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:30.055783 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.wsgi [None req-1506844c-9361-4d10-9c51-4515e04cd68d tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] HTTP exception thrown: Instance c30dcb83-017d-4428-9150-b68e8835ca64 could not be found. Nov 22 12:21:30.056721 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-1506844c-9361-4d10-9c51-4515e04cd68d tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Returning 404 to user: Instance c30dcb83-017d-4428-9150-b68e8835ca64 could not be found. {{(pid=116273) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 12:21:30.057967 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-1506844c-9361-4d10-9c51-4515e04cd68d tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] 10.222.0.66 "GET /compute/v2.1/servers/c30dcb83-017d-4428-9150-b68e8835ca64" status: 404 len: 111 microversion: 2.1 time: 0.031862 Nov 22 12:21:30.059026 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 232/478] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:21:30 2021] GET /compute/v2.1/servers/c30dcb83-017d-4428-9150-b68e8835ca64 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 22 12:21:30.073220 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-e6f64528-2089-4775-9044-433084684d07 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "POST /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21/action" status: 200 len: 17602 microversion: 2.1 time: 0.146887 Nov 22 12:21:30.074233 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 247/479] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Nov 22 12:21:29 2021] POST /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21/action => generated 17602 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 12:21:30.177361 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-a913a95b-d948-4d81-a9d3-ddbcd3b2870c tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1408428463", "imageRef": "31affc49-b6f0-44da-af65-4c65d72458b9", "flavorRef": "452", "networks": [{"uuid": "bb1f7e53-c4b2-4051-a4a6-124cbdcb8410"}]}} {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:21:30.230733 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-7cb6cd60-2702-41dc-b862-a6c2bfb3d53e tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:21:30.231956 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-7cb6cd60-2702-41dc-b862-a6c2bfb3d53e tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: c9f6d441-246f-479e-8e88-ea701c0f87ff] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:30.251550 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-7cb6cd60-2702-41dc-b862-a6c2bfb3d53e tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:30.251998 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-7cb6cd60-2702-41dc-b862-a6c2bfb3d53e tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:30.257991 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.network.neutron [None req-a913a95b-d948-4d81-a9d3-ddbcd3b2870c tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] validate_networks() for [('bb1f7e53-c4b2-4051-a4a6-124cbdcb8410', None, None, None, None, None)] {{(pid=116273) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 22 12:21:30.263153 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-7cb6cd60-2702-41dc-b862-a6c2bfb3d53e tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:30.263776 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-7cb6cd60-2702-41dc-b862-a6c2bfb3d53e tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:30.381210 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-7cb6cd60-2702-41dc-b862-a6c2bfb3d53e tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "POST /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff/action" status: 200 len: 36610 microversion: 2.20 time: 0.155355 Nov 22 12:21:30.381865 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 248/480] 10.222.0.66 () {62 vars in 1318 bytes} [Mon Nov 22 12:21:30 2021] POST /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff/action => generated 36610 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 12:21:30.464324 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-9c79f630-741f-4144-b2df-0b3488b1f65d tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:21:30.466589 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-9c79f630-741f-4144-b2df-0b3488b1f65d tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] [instance: d457eff7-4539-4ee1-8c94-c51cd4b5b2c1] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:30.480135 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-9c79f630-741f-4144-b2df-0b3488b1f65d tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:30.481173 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-9c79f630-741f-4144-b2df-0b3488b1f65d tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:30.483164 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-9c79f630-741f-4144-b2df-0b3488b1f65d tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:30.484927 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-9c79f630-741f-4144-b2df-0b3488b1f65d tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:30.548083 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-9c79f630-741f-4144-b2df-0b3488b1f65d tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] 10.222.0.66 "GET /compute/v2.1/servers/d457eff7-4539-4ee1-8c94-c51cd4b5b2c1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.091131 Nov 22 12:21:30.550067 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 249/481] 10.222.0.66 () {58 vars in 1301 bytes} [Mon Nov 22 12:21:30 2021] GET /compute/v2.1/servers/d457eff7-4539-4ee1-8c94-c51cd4b5b2c1/os-volume_attachments => generated 197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 12:21:30.757766 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.virt.hardware [None req-a913a95b-d948-4d81-a9d3-ddbcd3b2870c tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Flavor limits 0:0:0 {{(pid=116273) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 22 12:21:30.758452 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.virt.hardware [None req-a913a95b-d948-4d81-a9d3-ddbcd3b2870c tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Image limits 0:0:0 {{(pid=116273) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 22 12:21:30.759210 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.virt.hardware [None req-a913a95b-d948-4d81-a9d3-ddbcd3b2870c tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Flavor pref 0:0:0 {{(pid=116273) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 22 12:21:30.760067 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.virt.hardware [None req-a913a95b-d948-4d81-a9d3-ddbcd3b2870c tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Image pref 0:0:0 {{(pid=116273) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 22 12:21:30.760653 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.virt.hardware [None req-a913a95b-d948-4d81-a9d3-ddbcd3b2870c tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116273) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 22 12:21:30.784443 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-a913a95b-d948-4d81-a9d3-ddbcd3b2870c tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:30.785258 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-a913a95b-d948-4d81-a9d3-ddbcd3b2870c tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:30.786310 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-a913a95b-d948-4d81-a9d3-ddbcd3b2870c tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:30.787199 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-a913a95b-d948-4d81-a9d3-ddbcd3b2870c tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:30.807716 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.quota [None req-a913a95b-d948-4d81-a9d3-ddbcd3b2870c tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Getting quotas for project ad46aac0327b4760bef46d579031abd2. Resources: {'ram', 'instances', 'cores'} {{(pid=116273) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 22 12:21:30.813000 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.quota [None req-a913a95b-d948-4d81-a9d3-ddbcd3b2870c tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Getting quotas for user 8989f156c213442795edd8b9195bcbb3 and project ad46aac0327b4760bef46d579031abd2. Resources: {'ram', 'instances', 'cores'} {{(pid=116273) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 22 12:21:30.824041 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-a913a95b-d948-4d81-a9d3-ddbcd3b2870c tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Going to run 1 instances... {{(pid=116273) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 22 12:21:30.826811 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-a913a95b-d948-4d81-a9d3-ddbcd3b2870c tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] [instance: 049121a2-b87d-4df0-ab75-a4d346f27d22] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='31affc49-b6f0-44da-af65-4c65d72458b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116273) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 22 12:21:30.923063 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-6f829c71-595f-40da-a7e1-3c36aa6512f8 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:21:30.923721 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-6f829c71-595f-40da-a7e1-3c36aa6512f8 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] [instance: 302ab8ef-5565-4f9b-9b91-b405d550a90d] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:30.930014 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-6f829c71-595f-40da-a7e1-3c36aa6512f8 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:30.936732 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-6f829c71-595f-40da-a7e1-3c36aa6512f8 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:30.937625 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-6f829c71-595f-40da-a7e1-3c36aa6512f8 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:30.938054 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-6f829c71-595f-40da-a7e1-3c36aa6512f8 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:30.944451 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-a913a95b-d948-4d81-a9d3-ddbcd3b2870c tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.772952 Nov 22 12:21:30.952196 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 233/482] 10.222.0.66 () {60 vars in 1146 bytes} [Mon Nov 22 12:21:30 2021] POST /compute/v2.1/servers => generated 380 bytes in 781 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 22 12:21:30.962196 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-20fc6779-19ff-45b9-a4ee-64dd6dfc68ed tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:21:30.963032 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-20fc6779-19ff-45b9-a4ee-64dd6dfc68ed tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] [instance: 049121a2-b87d-4df0-ab75-a4d346f27d22] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:31.113168 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-20fc6779-19ff-45b9-a4ee-64dd6dfc68ed tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8989f156c213442795edd8b9195bcbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad46aac0327b4760bef46d579031abd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:21:31.125544 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-20fc6779-19ff-45b9-a4ee-64dd6dfc68ed tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] 10.222.0.66 "GET /compute/v2.1/servers/049121a2-b87d-4df0-ab75-a4d346f27d22" status: 200 len: 1214 microversion: 2.1 time: 0.171846 Nov 22 12:21:31.142905 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 234/483] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:21:30 2021] GET /compute/v2.1/servers/049121a2-b87d-4df0-ab75-a4d346f27d22 => generated 1214 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:21:31.150923 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-99fc1a41-3552-40df-a5d1-23d2ff788964 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:21:31.158637 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-99fc1a41-3552-40df-a5d1-23d2ff788964 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: 2306113c-8f98-42fd-8c0c-3dfac98fff21] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:31.172947 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-99fc1a41-3552-40df-a5d1-23d2ff788964 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:31.175152 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-99fc1a41-3552-40df-a5d1-23d2ff788964 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:31.178297 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-99fc1a41-3552-40df-a5d1-23d2ff788964 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:31.178995 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-99fc1a41-3552-40df-a5d1-23d2ff788964 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:31.219445 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-6f829c71-595f-40da-a7e1-3c36aa6512f8 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1efac6c215148ce8c3ecdce1e9a8742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d392a7d77f46fcb4faa017786796fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:21:31.231824 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-6f829c71-595f-40da-a7e1-3c36aa6512f8 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] 10.222.0.66 "GET /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d" status: 200 len: 1515 microversion: 2.1 time: 0.312540 Nov 22 12:21:31.232553 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 250/484] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:21:30 2021] GET /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d => generated 1515 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 12:21:31.318645 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-99fc1a41-3552-40df-a5d1-23d2ff788964 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "POST /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21/action" status: 200 len: 18350 microversion: 2.1 time: 0.174228 Nov 22 12:21:31.319546 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 235/485] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Nov 22 12:21:31 2021] POST /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21/action => generated 18350 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 12:21:31.393515 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-db5a1ee2-13d8-4871-ae94-bfd3ea67f391 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:21:31.394650 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-db5a1ee2-13d8-4871-ae94-bfd3ea67f391 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: c9f6d441-246f-479e-8e88-ea701c0f87ff] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:31.415251 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-db5a1ee2-13d8-4871-ae94-bfd3ea67f391 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:31.416234 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-db5a1ee2-13d8-4871-ae94-bfd3ea67f391 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:31.417461 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-db5a1ee2-13d8-4871-ae94-bfd3ea67f391 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:31.418300 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-db5a1ee2-13d8-4871-ae94-bfd3ea67f391 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:31.563005 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-3c10515c-138d-43ca-ad70-3cc232efa7b0 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:21:31.564289 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-3c10515c-138d-43ca-ad70-3cc232efa7b0 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] [instance: d457eff7-4539-4ee1-8c94-c51cd4b5b2c1] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:31.574394 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-3c10515c-138d-43ca-ad70-3cc232efa7b0 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:31.575085 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-3c10515c-138d-43ca-ad70-3cc232efa7b0 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:31.576393 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-3c10515c-138d-43ca-ad70-3cc232efa7b0 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:31.576995 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-3c10515c-138d-43ca-ad70-3cc232efa7b0 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:31.615892 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-db5a1ee2-13d8-4871-ae94-bfd3ea67f391 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "POST /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff/action" status: 200 len: 37431 microversion: 2.20 time: 0.225894 Nov 22 12:21:31.621017 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 251/486] 10.222.0.66 () {62 vars in 1318 bytes} [Mon Nov 22 12:21:31 2021] POST /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff/action => generated 37431 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 12:21:31.653981 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-3c10515c-138d-43ca-ad70-3cc232efa7b0 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] 10.222.0.66 "GET /compute/v2.1/servers/d457eff7-4539-4ee1-8c94-c51cd4b5b2c1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.095326 Nov 22 12:21:31.654878 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 236/487] 10.222.0.66 () {58 vars in 1301 bytes} [Mon Nov 22 12:21:31 2021] GET /compute/v2.1/servers/d457eff7-4539-4ee1-8c94-c51cd4b5b2c1/os-volume_attachments => generated 197 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 22 12:21:32.145287 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-7abe1002-61e1-433f-bfd6-391a01dd84cb tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:21:32.146588 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-7abe1002-61e1-433f-bfd6-391a01dd84cb tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] [instance: 049121a2-b87d-4df0-ab75-a4d346f27d22] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:32.156847 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-7abe1002-61e1-433f-bfd6-391a01dd84cb tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:32.157307 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-7abe1002-61e1-433f-bfd6-391a01dd84cb tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:32.158103 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-7abe1002-61e1-433f-bfd6-391a01dd84cb tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:32.158538 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-7abe1002-61e1-433f-bfd6-391a01dd84cb tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:32.230668 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-7abe1002-61e1-433f-bfd6-391a01dd84cb tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8989f156c213442795edd8b9195bcbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad46aac0327b4760bef46d579031abd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:21:32.241545 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-7abe1002-61e1-433f-bfd6-391a01dd84cb tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] 10.222.0.66 "GET /compute/v2.1/servers/049121a2-b87d-4df0-ab75-a4d346f27d22" status: 200 len: 1266 microversion: 2.1 time: 0.100281 Nov 22 12:21:32.242111 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 252/488] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:21:32 2021] GET /compute/v2.1/servers/049121a2-b87d-4df0-ab75-a4d346f27d22 => generated 1266 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:21:32.331774 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-398303c0-04c1-437d-9d6d-e804dc9963a0 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:21:32.333134 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-398303c0-04c1-437d-9d6d-e804dc9963a0 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: 2306113c-8f98-42fd-8c0c-3dfac98fff21] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:32.340780 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-398303c0-04c1-437d-9d6d-e804dc9963a0 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:32.341228 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-398303c0-04c1-437d-9d6d-e804dc9963a0 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:32.342924 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-398303c0-04c1-437d-9d6d-e804dc9963a0 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:32.343389 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-398303c0-04c1-437d-9d6d-e804dc9963a0 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:32.492389 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-398303c0-04c1-437d-9d6d-e804dc9963a0 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "POST /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21/action" status: 200 len: 19759 microversion: 2.1 time: 0.165323 Nov 22 12:21:32.493455 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 237/489] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Nov 22 12:21:32 2021] POST /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21/action => generated 19759 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 12:21:32.628434 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-52ad0af2-8c14-43a6-b689-0f4b60521227 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:21:32.629359 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-52ad0af2-8c14-43a6-b689-0f4b60521227 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: c9f6d441-246f-479e-8e88-ea701c0f87ff] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:32.640094 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-52ad0af2-8c14-43a6-b689-0f4b60521227 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:32.641035 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-52ad0af2-8c14-43a6-b689-0f4b60521227 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:32.642735 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-52ad0af2-8c14-43a6-b689-0f4b60521227 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:32.643666 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-52ad0af2-8c14-43a6-b689-0f4b60521227 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:32.666642 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-079376b4-7652-4198-acb6-8238bdad92d3 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:21:32.667958 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-079376b4-7652-4198-acb6-8238bdad92d3 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] [instance: d457eff7-4539-4ee1-8c94-c51cd4b5b2c1] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:32.701491 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-079376b4-7652-4198-acb6-8238bdad92d3 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:32.702243 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-079376b4-7652-4198-acb6-8238bdad92d3 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:32.703254 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-079376b4-7652-4198-acb6-8238bdad92d3 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:32.704089 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-079376b4-7652-4198-acb6-8238bdad92d3 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:32.751844 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-079376b4-7652-4198-acb6-8238bdad92d3 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] 10.222.0.66 "GET /compute/v2.1/servers/d457eff7-4539-4ee1-8c94-c51cd4b5b2c1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.089495 Nov 22 12:21:32.753279 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 238/490] 10.222.0.66 () {58 vars in 1301 bytes} [Mon Nov 22 12:21:32 2021] GET /compute/v2.1/servers/d457eff7-4539-4ee1-8c94-c51cd4b5b2c1/os-volume_attachments => generated 197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 12:21:32.808806 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-5bf2e6a1-14a5-4935-93d9-473428a9366f tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:21:32.809653 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-5bf2e6a1-14a5-4935-93d9-473428a9366f tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] [instance: 302ab8ef-5565-4f9b-9b91-b405d550a90d] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:32.821132 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-5bf2e6a1-14a5-4935-93d9-473428a9366f tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:32.821550 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-5bf2e6a1-14a5-4935-93d9-473428a9366f tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:32.824570 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-5bf2e6a1-14a5-4935-93d9-473428a9366f tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:32.825093 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-5bf2e6a1-14a5-4935-93d9-473428a9366f tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:32.846458 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-52ad0af2-8c14-43a6-b689-0f4b60521227 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "POST /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff/action" status: 200 len: 37959 microversion: 2.20 time: 0.221727 Nov 22 12:21:32.848014 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 253/491] 10.222.0.66 () {62 vars in 1318 bytes} [Mon Nov 22 12:21:32 2021] POST /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff/action => generated 37959 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 12:21:33.002780 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-5bf2e6a1-14a5-4935-93d9-473428a9366f tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1efac6c215148ce8c3ecdce1e9a8742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d392a7d77f46fcb4faa017786796fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:21:33.020195 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-5bf2e6a1-14a5-4935-93d9-473428a9366f tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] 10.222.0.66 "GET /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d" status: 200 len: 1515 microversion: 2.1 time: 0.214971 Nov 22 12:21:33.020792 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 239/492] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:21:32 2021] GET /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d => generated 1515 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 12:21:33.037255 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-3854f3ad-ca33-49fa-b19b-aa4e32902df4 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dd8e16c4-0006-4848-a35a-fcd0386356f1"}} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:21:33.038741 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-3854f3ad-ca33-49fa-b19b-aa4e32902df4 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] [instance: 302ab8ef-5565-4f9b-9b91-b405d550a90d] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:33.047043 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-3854f3ad-ca33-49fa-b19b-aa4e32902df4 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:33.047542 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-3854f3ad-ca33-49fa-b19b-aa4e32902df4 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:33.048361 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-3854f3ad-ca33-49fa-b19b-aa4e32902df4 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:33.048995 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-3854f3ad-ca33-49fa-b19b-aa4e32902df4 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:33.267988 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-7fad4563-58c1-4efc-8c36-f882a77ec7a9 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:21:33.268760 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-7fad4563-58c1-4efc-8c36-f882a77ec7a9 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] [instance: 049121a2-b87d-4df0-ab75-a4d346f27d22] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:33.279552 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-7fad4563-58c1-4efc-8c36-f882a77ec7a9 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:33.283518 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-7fad4563-58c1-4efc-8c36-f882a77ec7a9 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:33.286281 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-7fad4563-58c1-4efc-8c36-f882a77ec7a9 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:33.288254 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-7fad4563-58c1-4efc-8c36-f882a77ec7a9 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:33.381904 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-3854f3ad-ca33-49fa-b19b-aa4e32902df4 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] 10.222.0.66 "POST /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.348458 Nov 22 12:21:33.392964 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-7fad4563-58c1-4efc-8c36-f882a77ec7a9 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8989f156c213442795edd8b9195bcbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad46aac0327b4760bef46d579031abd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:21:33.399545 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 254/493] 10.222.0.66 () {60 vars in 1322 bytes} [Mon Nov 22 12:21:33 2021] POST /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d/os-volume_attachments => generated 194 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 12:21:33.404017 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-7fad4563-58c1-4efc-8c36-f882a77ec7a9 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] 10.222.0.66 "GET /compute/v2.1/servers/049121a2-b87d-4df0-ab75-a4d346f27d22" status: 200 len: 1272 microversion: 2.1 time: 0.142495 Nov 22 12:21:33.405216 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 240/494] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:21:33 2021] GET /compute/v2.1/servers/049121a2-b87d-4df0-ab75-a4d346f27d22 => generated 1272 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:21:33.516868 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-a4ae547f-d690-4fa1-aa80-f67f3577eae1 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:21:33.518384 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-a4ae547f-d690-4fa1-aa80-f67f3577eae1 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: 2306113c-8f98-42fd-8c0c-3dfac98fff21] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:33.526785 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-a4ae547f-d690-4fa1-aa80-f67f3577eae1 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:33.527137 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-a4ae547f-d690-4fa1-aa80-f67f3577eae1 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:33.528116 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-a4ae547f-d690-4fa1-aa80-f67f3577eae1 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:33.528683 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-a4ae547f-d690-4fa1-aa80-f67f3577eae1 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:33.660257 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-a4ae547f-d690-4fa1-aa80-f67f3577eae1 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "POST /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21/action" status: 200 len: 21343 microversion: 2.1 time: 0.150178 Nov 22 12:21:33.661237 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 255/495] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Nov 22 12:21:33 2021] POST /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21/action => generated 21343 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 12:21:33.764570 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-9070bdc2-79c9-4a79-a077-1a2e6715584c tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:21:33.765741 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-9070bdc2-79c9-4a79-a077-1a2e6715584c tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] [instance: d457eff7-4539-4ee1-8c94-c51cd4b5b2c1] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:33.772907 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-9070bdc2-79c9-4a79-a077-1a2e6715584c tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:33.773574 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-9070bdc2-79c9-4a79-a077-1a2e6715584c tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:33.774560 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-9070bdc2-79c9-4a79-a077-1a2e6715584c tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:33.775138 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-9070bdc2-79c9-4a79-a077-1a2e6715584c tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:33.813116 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-9070bdc2-79c9-4a79-a077-1a2e6715584c tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] 10.222.0.66 "GET /compute/v2.1/servers/d457eff7-4539-4ee1-8c94-c51cd4b5b2c1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052500 Nov 22 12:21:33.817545 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 241/496] 10.222.0.66 () {58 vars in 1301 bytes} [Mon Nov 22 12:21:33 2021] GET /compute/v2.1/servers/d457eff7-4539-4ee1-8c94-c51cd4b5b2c1/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 12:21:33.858510 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-f4be0566-2071-49ab-a906-ca1c6c91cf9b tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:21:33.859984 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-f4be0566-2071-49ab-a906-ca1c6c91cf9b tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: c9f6d441-246f-479e-8e88-ea701c0f87ff] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:33.867161 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-f4be0566-2071-49ab-a906-ca1c6c91cf9b tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:33.867641 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-f4be0566-2071-49ab-a906-ca1c6c91cf9b tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:33.868492 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-f4be0566-2071-49ab-a906-ca1c6c91cf9b tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:33.868986 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-f4be0566-2071-49ab-a906-ca1c6c91cf9b tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:33.984967 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-f4be0566-2071-49ab-a906-ca1c6c91cf9b tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "POST /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff/action" status: 200 len: 38011 microversion: 2.20 time: 0.129964 Nov 22 12:21:33.985813 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 256/497] 10.222.0.66 () {62 vars in 1318 bytes} [Mon Nov 22 12:21:33 2021] POST /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff/action => generated 38011 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 22 12:21:34.422578 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-e3ed3ec4-0eec-4275-ba22-c8d099e41f29 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:21:34.423982 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-e3ed3ec4-0eec-4275-ba22-c8d099e41f29 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] [instance: 049121a2-b87d-4df0-ab75-a4d346f27d22] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:34.432730 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-e3ed3ec4-0eec-4275-ba22-c8d099e41f29 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:34.433708 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-e3ed3ec4-0eec-4275-ba22-c8d099e41f29 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:34.435116 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-e3ed3ec4-0eec-4275-ba22-c8d099e41f29 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:34.436046 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-e3ed3ec4-0eec-4275-ba22-c8d099e41f29 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:34.473088 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [req-976a8f80-38dd-4de7-afcf-d8dc9902b52a req-66fbe25d-f716-4d83-a40c-1f71856a2779 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "049121a2-b87d-4df0-ab75-a4d346f27d22", "tag": "a4b96091-b3aa-436d-a620-de83c69919aa"}]} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:21:34.477273 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 12:21:34.477273 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: warnings.warn(msg) Nov 22 12:21:34.493224 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [req-976a8f80-38dd-4de7-afcf-d8dc9902b52a req-66fbe25d-f716-4d83-a40c-1f71856a2779 service nova] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:34.493931 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [req-976a8f80-38dd-4de7-afcf-d8dc9902b52a req-66fbe25d-f716-4d83-a40c-1f71856a2779 service nova] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:34.509590 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.compute.server_external_events [req-976a8f80-38dd-4de7-afcf-d8dc9902b52a req-66fbe25d-f716-4d83-a40c-1f71856a2779 service nova] Creating event network-changed:a4b96091-b3aa-436d-a620-de83c69919aa for instance 049121a2-b87d-4df0-ab75-a4d346f27d22 on hv-cinder-76845 Nov 22 12:21:34.516177 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [req-976a8f80-38dd-4de7-afcf-d8dc9902b52a req-66fbe25d-f716-4d83-a40c-1f71856a2779 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047313 Nov 22 12:21:34.517404 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 257/498] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Nov 22 12:21:34 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 22 12:21:34.682432 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-2767eac1-4a79-418b-a092-53308272e7ff tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:21:34.684301 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-2767eac1-4a79-418b-a092-53308272e7ff tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: 2306113c-8f98-42fd-8c0c-3dfac98fff21] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:34.696967 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-2767eac1-4a79-418b-a092-53308272e7ff tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:34.697407 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-2767eac1-4a79-418b-a092-53308272e7ff tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:34.698209 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-2767eac1-4a79-418b-a092-53308272e7ff tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:34.698644 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-2767eac1-4a79-418b-a092-53308272e7ff tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:34.723434 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-e3ed3ec4-0eec-4275-ba22-c8d099e41f29 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8989f156c213442795edd8b9195bcbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad46aac0327b4760bef46d579031abd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:21:34.734061 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-e3ed3ec4-0eec-4275-ba22-c8d099e41f29 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] 10.222.0.66 "GET /compute/v2.1/servers/049121a2-b87d-4df0-ab75-a4d346f27d22" status: 200 len: 1314 microversion: 2.1 time: 0.315021 Nov 22 12:21:34.736012 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 242/499] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:21:34 2021] GET /compute/v2.1/servers/049121a2-b87d-4df0-ab75-a4d346f27d22 => generated 1314 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:21:34.824315 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-a8c270ea-31ee-475a-a253-32061aa87ab0 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:21:34.825261 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-a8c270ea-31ee-475a-a253-32061aa87ab0 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] [instance: d457eff7-4539-4ee1-8c94-c51cd4b5b2c1] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:34.838753 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-a8c270ea-31ee-475a-a253-32061aa87ab0 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:34.839208 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-a8c270ea-31ee-475a-a253-32061aa87ab0 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:34.840039 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-a8c270ea-31ee-475a-a253-32061aa87ab0 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:34.842057 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-a8c270ea-31ee-475a-a253-32061aa87ab0 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:34.895802 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-2767eac1-4a79-418b-a092-53308272e7ff tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "POST /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21/action" status: 200 len: 22501 microversion: 2.1 time: 0.221058 Nov 22 12:21:34.900215 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 258/500] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Nov 22 12:21:34 2021] POST /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21/action => generated 22501 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 22 12:21:34.910858 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-a8c270ea-31ee-475a-a253-32061aa87ab0 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] 10.222.0.66 "GET /compute/v2.1/servers/d457eff7-4539-4ee1-8c94-c51cd4b5b2c1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.090229 Nov 22 12:21:34.915683 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 243/501] 10.222.0.66 () {58 vars in 1301 bytes} [Mon Nov 22 12:21:34 2021] GET /compute/v2.1/servers/d457eff7-4539-4ee1-8c94-c51cd4b5b2c1/os-volume_attachments => generated 197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 12:21:34.999728 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-ae86c423-0988-428b-be5b-fb0b33882c51 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:21:35.001061 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-ae86c423-0988-428b-be5b-fb0b33882c51 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: c9f6d441-246f-479e-8e88-ea701c0f87ff] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:35.019145 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-ae86c423-0988-428b-be5b-fb0b33882c51 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:35.022772 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-ae86c423-0988-428b-be5b-fb0b33882c51 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:35.025606 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-ae86c423-0988-428b-be5b-fb0b33882c51 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:35.026064 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-ae86c423-0988-428b-be5b-fb0b33882c51 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:35.157858 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-ae86c423-0988-428b-be5b-fb0b33882c51 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "POST /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff/action" status: 200 len: 38153 microversion: 2.20 time: 0.164007 Nov 22 12:21:35.165225 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 259/502] 10.222.0.66 () {62 vars in 1318 bytes} [Mon Nov 22 12:21:34 2021] POST /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff/action => generated 38153 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 12:21:35.178298 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-e751010c-d844-48b3-8c81-f7dcf7256285 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:21:35.181067 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-e751010c-d844-48b3-8c81-f7dcf7256285 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: c9f6d441-246f-479e-8e88-ea701c0f87ff] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:35.198027 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-e751010c-d844-48b3-8c81-f7dcf7256285 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:35.198480 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-e751010c-d844-48b3-8c81-f7dcf7256285 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:35.199456 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-e751010c-d844-48b3-8c81-f7dcf7256285 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:35.199756 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-e751010c-d844-48b3-8c81-f7dcf7256285 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:35.243955 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-e751010c-d844-48b3-8c81-f7dcf7256285 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff/ips" status: 200 len: 152 microversion: 2.20 time: 0.071805 Nov 22 12:21:35.244559 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 244/503] 10.222.0.66 () {60 vars in 1288 bytes} [Mon Nov 22 12:21:35 2021] GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff/ips => generated 152 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 12:21:35.750192 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-cf061d5d-74a7-48b8-9a98-cad6ddc2d3bd tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:21:35.752091 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-cf061d5d-74a7-48b8-9a98-cad6ddc2d3bd tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] [instance: 049121a2-b87d-4df0-ab75-a4d346f27d22] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:35.778522 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-cf061d5d-74a7-48b8-9a98-cad6ddc2d3bd tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:35.779313 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-cf061d5d-74a7-48b8-9a98-cad6ddc2d3bd tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:35.779961 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-cf061d5d-74a7-48b8-9a98-cad6ddc2d3bd tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:35.780409 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-cf061d5d-74a7-48b8-9a98-cad6ddc2d3bd tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:35.908830 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-14cc6891-b5f3-416a-b244-d90319497a47 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:21:35.910626 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-14cc6891-b5f3-416a-b244-d90319497a47 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: 2306113c-8f98-42fd-8c0c-3dfac98fff21] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:35.945839 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-14cc6891-b5f3-416a-b244-d90319497a47 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:35.947931 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-14cc6891-b5f3-416a-b244-d90319497a47 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:35.952575 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-14cc6891-b5f3-416a-b244-d90319497a47 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:35.955767 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-14cc6891-b5f3-416a-b244-d90319497a47 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:36.112490 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-14cc6891-b5f3-416a-b244-d90319497a47 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "POST /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21/action" status: 200 len: 23226 microversion: 2.1 time: 0.208373 Nov 22 12:21:36.113503 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 245/504] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Nov 22 12:21:35 2021] POST /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21/action => generated 23226 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 22 12:21:36.138356 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-f322db9f-8b3b-4992-bfee-fda577df150a tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:21:36.139698 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-f322db9f-8b3b-4992-bfee-fda577df150a tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] [instance: d457eff7-4539-4ee1-8c94-c51cd4b5b2c1] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:36.165772 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-f322db9f-8b3b-4992-bfee-fda577df150a tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:36.166489 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-f322db9f-8b3b-4992-bfee-fda577df150a tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:36.170052 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-f322db9f-8b3b-4992-bfee-fda577df150a tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:36.171265 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-f322db9f-8b3b-4992-bfee-fda577df150a tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:36.218408 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-f322db9f-8b3b-4992-bfee-fda577df150a tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] 10.222.0.66 "GET /compute/v2.1/servers/d457eff7-4539-4ee1-8c94-c51cd4b5b2c1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.103141 Nov 22 12:21:36.219276 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 246/505] 10.222.0.66 () {58 vars in 1301 bytes} [Mon Nov 22 12:21:36 2021] GET /compute/v2.1/servers/d457eff7-4539-4ee1-8c94-c51cd4b5b2c1/os-volume_attachments => generated 197 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 12:21:36.390907 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-cf061d5d-74a7-48b8-9a98-cad6ddc2d3bd tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8989f156c213442795edd8b9195bcbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad46aac0327b4760bef46d579031abd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:21:36.410108 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-cf061d5d-74a7-48b8-9a98-cad6ddc2d3bd tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] 10.222.0.66 "GET /compute/v2.1/servers/049121a2-b87d-4df0-ab75-a4d346f27d22" status: 200 len: 1314 microversion: 2.1 time: 0.663281 Nov 22 12:21:36.411459 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 260/506] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:21:35 2021] GET /compute/v2.1/servers/049121a2-b87d-4df0-ab75-a4d346f27d22 => generated 1314 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:21:37.126732 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-6c0db397-8412-42f4-aefa-4abd8af90b4a tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:21:37.132016 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-6c0db397-8412-42f4-aefa-4abd8af90b4a tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: 2306113c-8f98-42fd-8c0c-3dfac98fff21] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:37.144808 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-6c0db397-8412-42f4-aefa-4abd8af90b4a tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:37.145563 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-6c0db397-8412-42f4-aefa-4abd8af90b4a tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:37.146587 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-6c0db397-8412-42f4-aefa-4abd8af90b4a tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:37.147018 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-6c0db397-8412-42f4-aefa-4abd8af90b4a tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:37.232503 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-b3334538-e90e-41fe-9a13-8131bd4d97e0 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:21:37.234071 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-b3334538-e90e-41fe-9a13-8131bd4d97e0 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] [instance: d457eff7-4539-4ee1-8c94-c51cd4b5b2c1] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:37.247737 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-b3334538-e90e-41fe-9a13-8131bd4d97e0 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:37.249493 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-b3334538-e90e-41fe-9a13-8131bd4d97e0 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:37.250487 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-b3334538-e90e-41fe-9a13-8131bd4d97e0 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:37.250946 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-b3334538-e90e-41fe-9a13-8131bd4d97e0 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:37.351044 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-b3334538-e90e-41fe-9a13-8131bd4d97e0 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] 10.222.0.66 "GET /compute/v2.1/servers/d457eff7-4539-4ee1-8c94-c51cd4b5b2c1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.124371 Nov 22 12:21:37.352498 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 261/507] 10.222.0.66 () {58 vars in 1301 bytes} [Mon Nov 22 12:21:37 2021] GET /compute/v2.1/servers/d457eff7-4539-4ee1-8c94-c51cd4b5b2c1/os-volume_attachments => generated 197 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 12:21:37.433460 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-e9848555-c8e3-43d1-8c3b-402cfa6a00a2 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:21:37.434455 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-e9848555-c8e3-43d1-8c3b-402cfa6a00a2 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] [instance: 049121a2-b87d-4df0-ab75-a4d346f27d22] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:37.455326 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-e9848555-c8e3-43d1-8c3b-402cfa6a00a2 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:37.458517 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-e9848555-c8e3-43d1-8c3b-402cfa6a00a2 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:37.459719 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-e9848555-c8e3-43d1-8c3b-402cfa6a00a2 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:37.460778 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-e9848555-c8e3-43d1-8c3b-402cfa6a00a2 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:37.924102 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-e9848555-c8e3-43d1-8c3b-402cfa6a00a2 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8989f156c213442795edd8b9195bcbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad46aac0327b4760bef46d579031abd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:21:37.932000 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-e9848555-c8e3-43d1-8c3b-402cfa6a00a2 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] 10.222.0.66 "GET /compute/v2.1/servers/049121a2-b87d-4df0-ab75-a4d346f27d22" status: 200 len: 1314 microversion: 2.1 time: 0.506812 Nov 22 12:21:37.936371 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 262/508] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:21:37 2021] GET /compute/v2.1/servers/049121a2-b87d-4df0-ab75-a4d346f27d22 => generated 1314 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:21:38.363822 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-b4b8da9a-3e75-4570-81fe-e5c33b568f25 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:21:38.365171 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-b4b8da9a-3e75-4570-81fe-e5c33b568f25 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] [instance: d457eff7-4539-4ee1-8c94-c51cd4b5b2c1] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:38.378959 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-b4b8da9a-3e75-4570-81fe-e5c33b568f25 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:38.379686 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-b4b8da9a-3e75-4570-81fe-e5c33b568f25 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:38.383416 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-b4b8da9a-3e75-4570-81fe-e5c33b568f25 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:38.384386 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-b4b8da9a-3e75-4570-81fe-e5c33b568f25 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:38.464130 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-b4b8da9a-3e75-4570-81fe-e5c33b568f25 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] 10.222.0.66 "GET /compute/v2.1/servers/d457eff7-4539-4ee1-8c94-c51cd4b5b2c1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.103982 Nov 22 12:21:38.465582 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 263/509] 10.222.0.66 () {58 vars in 1301 bytes} [Mon Nov 22 12:21:38 2021] GET /compute/v2.1/servers/d457eff7-4539-4ee1-8c94-c51cd4b5b2c1/os-volume_attachments => generated 197 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 12:21:38.942062 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-8acf2a33-3ef4-4622-bee5-b3933a1c42eb tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Action: 'create', calling method: .version_select at 0x7fa1a3d36940>, body: {"keypair": {"name": "tempest-TestShelveInstance-1481680365"}} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:21:38.957517 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.quota [None req-8acf2a33-3ef4-4622-bee5-b3933a1c42eb tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Getting quotas for project 575f4ae5262e4930b6658095a1aa8a32. Resources: {'key_pairs'} {{(pid=116272) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 22 12:21:38.965592 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.quota [None req-8acf2a33-3ef4-4622-bee5-b3933a1c42eb tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Getting quotas for user 67c15e2c2fa94be8b638f2257efb5820 and project 575f4ae5262e4930b6658095a1aa8a32. Resources: {'key_pairs'} {{(pid=116272) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 22 12:21:39.161312 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.quota [None req-8acf2a33-3ef4-4622-bee5-b3933a1c42eb tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Getting quotas for project 575f4ae5262e4930b6658095a1aa8a32. Resources: {'key_pairs'} {{(pid=116272) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 22 12:21:39.165402 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.quota [None req-8acf2a33-3ef4-4622-bee5-b3933a1c42eb tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Getting quotas for user 67c15e2c2fa94be8b638f2257efb5820 and project 575f4ae5262e4930b6658095a1aa8a32. Resources: {'key_pairs'} {{(pid=116272) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 22 12:21:39.180958 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-8acf2a33-3ef4-4622-bee5-b3933a1c42eb tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 2316 microversion: 2.1 time: 0.459604 Nov 22 12:21:39.182288 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 264/510] 10.222.0.66 () {60 vars in 1157 bytes} [Mon Nov 22 12:21:38 2021] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 12:21:39.189384 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-2dba52e7-e31b-4aba-b0a8-0a2ae4435fe7 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:21:39.190524 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-2dba52e7-e31b-4aba-b0a8-0a2ae4435fe7 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] [instance: 049121a2-b87d-4df0-ab75-a4d346f27d22] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:39.197292 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-2dba52e7-e31b-4aba-b0a8-0a2ae4435fe7 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:39.197826 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-2dba52e7-e31b-4aba-b0a8-0a2ae4435fe7 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:39.198835 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-2dba52e7-e31b-4aba-b0a8-0a2ae4435fe7 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:39.199184 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-2dba52e7-e31b-4aba-b0a8-0a2ae4435fe7 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:39.443964 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-2dba52e7-e31b-4aba-b0a8-0a2ae4435fe7 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8989f156c213442795edd8b9195bcbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad46aac0327b4760bef46d579031abd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:21:39.460285 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-2dba52e7-e31b-4aba-b0a8-0a2ae4435fe7 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] 10.222.0.66 "GET /compute/v2.1/servers/049121a2-b87d-4df0-ab75-a4d346f27d22" status: 200 len: 1314 microversion: 2.1 time: 0.276579 Nov 22 12:21:39.470303 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 265/511] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:21:39 2021] GET /compute/v2.1/servers/049121a2-b87d-4df0-ab75-a4d346f27d22 => generated 1314 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:21:39.476229 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-3a7f1e31-62f5-41f9-9463-bb6625ff426a tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:21:39.477157 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-3a7f1e31-62f5-41f9-9463-bb6625ff426a tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] [instance: d457eff7-4539-4ee1-8c94-c51cd4b5b2c1] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:39.483368 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-3a7f1e31-62f5-41f9-9463-bb6625ff426a tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:39.483780 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-3a7f1e31-62f5-41f9-9463-bb6625ff426a tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:39.484612 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-3a7f1e31-62f5-41f9-9463-bb6625ff426a tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:39.485050 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-3a7f1e31-62f5-41f9-9463-bb6625ff426a tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:39.518359 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-3a7f1e31-62f5-41f9-9463-bb6625ff426a tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] 10.222.0.66 "GET /compute/v2.1/servers/d457eff7-4539-4ee1-8c94-c51cd4b5b2c1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045779 Nov 22 12:21:39.519177 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 266/512] 10.222.0.66 () {58 vars in 1301 bytes} [Mon Nov 22 12:21:39 2021] GET /compute/v2.1/servers/d457eff7-4539-4ee1-8c94-c51cd4b5b2c1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 22 12:21:39.863445 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-6c0db397-8412-42f4-aefa-4abd8af90b4a tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "POST /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21/action" status: 200 len: 25200 microversion: 2.1 time: 2.741942 Nov 22 12:21:39.864253 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 247/513] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Nov 22 12:21:37 2021] POST /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21/action => generated 25200 bytes in 2744 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 12:21:40.478489 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-d2a0f5dc-4338-41b9-9315-d402ada6a89d tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:21:40.480915 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-d2a0f5dc-4338-41b9-9315-d402ada6a89d tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] [instance: 049121a2-b87d-4df0-ab75-a4d346f27d22] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:40.498468 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-d2a0f5dc-4338-41b9-9315-d402ada6a89d tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:40.508994 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-d2a0f5dc-4338-41b9-9315-d402ada6a89d tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:40.510735 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-d2a0f5dc-4338-41b9-9315-d402ada6a89d tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:40.511408 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-d2a0f5dc-4338-41b9-9315-d402ada6a89d tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:40.531598 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-a06460ad-7b4b-440d-8822-9105c7955082 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:21:40.533215 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-a06460ad-7b4b-440d-8822-9105c7955082 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] [instance: d457eff7-4539-4ee1-8c94-c51cd4b5b2c1] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:40.541126 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-a06460ad-7b4b-440d-8822-9105c7955082 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:40.541920 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-a06460ad-7b4b-440d-8822-9105c7955082 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:40.543196 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-a06460ad-7b4b-440d-8822-9105c7955082 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:40.544196 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-a06460ad-7b4b-440d-8822-9105c7955082 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:40.586658 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-a06460ad-7b4b-440d-8822-9105c7955082 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] 10.222.0.66 "GET /compute/v2.1/servers/d457eff7-4539-4ee1-8c94-c51cd4b5b2c1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.059836 Nov 22 12:21:40.587620 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 248/514] 10.222.0.66 () {58 vars in 1301 bytes} [Mon Nov 22 12:21:40 2021] GET /compute/v2.1/servers/d457eff7-4539-4ee1-8c94-c51cd4b5b2c1/os-volume_attachments => generated 25 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 22 12:21:40.678084 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-d2a0f5dc-4338-41b9-9315-d402ada6a89d tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8989f156c213442795edd8b9195bcbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad46aac0327b4760bef46d579031abd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:21:40.685847 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-d2a0f5dc-4338-41b9-9315-d402ada6a89d tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] 10.222.0.66 "GET /compute/v2.1/servers/049121a2-b87d-4df0-ab75-a4d346f27d22" status: 200 len: 1314 microversion: 2.1 time: 0.211470 Nov 22 12:21:40.686805 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 267/515] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:21:40 2021] GET /compute/v2.1/servers/049121a2-b87d-4df0-ab75-a4d346f27d22 => generated 1314 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:21:40.876084 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-9c246b38-3ef7-4cbb-9bef-446634410225 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:21:40.877142 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-9c246b38-3ef7-4cbb-9bef-446634410225 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: 2306113c-8f98-42fd-8c0c-3dfac98fff21] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:40.883378 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-9c246b38-3ef7-4cbb-9bef-446634410225 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:40.884154 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-9c246b38-3ef7-4cbb-9bef-446634410225 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:40.885465 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-9c246b38-3ef7-4cbb-9bef-446634410225 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:40.886477 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-9c246b38-3ef7-4cbb-9bef-446634410225 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:41.020326 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-9c246b38-3ef7-4cbb-9bef-446634410225 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "POST /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21/action" status: 200 len: 25843 microversion: 2.1 time: 0.148300 Nov 22 12:21:41.020983 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 249/516] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Nov 22 12:21:40 2021] POST /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21/action => generated 25843 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 12:21:41.185878 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-2f37c4e6-a584-4d6b-9bce-9f497ea863fd tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1308952461", "imageRef": "31affc49-b6f0-44da-af65-4c65d72458b9", "flavorRef": "452", "networks": [{"uuid": "1a398bbd-8494-4c78-9a7f-9328646aea45"}]}} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:21:41.245269 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.network.neutron [None req-2f37c4e6-a584-4d6b-9bce-9f497ea863fd tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] validate_networks() for [('1a398bbd-8494-4c78-9a7f-9328646aea45', None, None, None, None, None)] {{(pid=116272) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 22 12:21:41.666135 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.virt.hardware [None req-2f37c4e6-a584-4d6b-9bce-9f497ea863fd tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Flavor limits 0:0:0 {{(pid=116272) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 22 12:21:41.666866 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.virt.hardware [None req-2f37c4e6-a584-4d6b-9bce-9f497ea863fd tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Image limits 0:0:0 {{(pid=116272) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 22 12:21:41.667440 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.virt.hardware [None req-2f37c4e6-a584-4d6b-9bce-9f497ea863fd tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Flavor pref 0:0:0 {{(pid=116272) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 22 12:21:41.667969 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.virt.hardware [None req-2f37c4e6-a584-4d6b-9bce-9f497ea863fd tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Image pref 0:0:0 {{(pid=116272) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 22 12:21:41.668451 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.virt.hardware [None req-2f37c4e6-a584-4d6b-9bce-9f497ea863fd tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116272) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 22 12:21:41.685624 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-2f37c4e6-a584-4d6b-9bce-9f497ea863fd tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:41.686335 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-2f37c4e6-a584-4d6b-9bce-9f497ea863fd tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:41.687396 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-2f37c4e6-a584-4d6b-9bce-9f497ea863fd tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:41.688053 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-2f37c4e6-a584-4d6b-9bce-9f497ea863fd tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:41.707572 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-f5b03f04-558d-43bd-afbe-4a6e01d36b57 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:21:41.708326 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-f5b03f04-558d-43bd-afbe-4a6e01d36b57 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] [instance: 049121a2-b87d-4df0-ab75-a4d346f27d22] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:41.708807 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.quota [None req-2f37c4e6-a584-4d6b-9bce-9f497ea863fd tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Getting quotas for project 5319fd2dee9b4b47b98f59bca1572ac8. Resources: {'ram', 'instances', 'cores'} {{(pid=116272) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 22 12:21:41.713535 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.quota [None req-2f37c4e6-a584-4d6b-9bce-9f497ea863fd tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Getting quotas for user 8a4b581fa25045cea9585ae4e707585d and project 5319fd2dee9b4b47b98f59bca1572ac8. Resources: {'ram', 'instances', 'cores'} {{(pid=116272) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 22 12:21:41.716455 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-f5b03f04-558d-43bd-afbe-4a6e01d36b57 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:41.716912 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-f5b03f04-558d-43bd-afbe-4a6e01d36b57 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:41.717750 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-f5b03f04-558d-43bd-afbe-4a6e01d36b57 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:41.718165 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-f5b03f04-558d-43bd-afbe-4a6e01d36b57 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:41.737408 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-2f37c4e6-a584-4d6b-9bce-9f497ea863fd tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Going to run 1 instances... {{(pid=116272) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 22 12:21:41.739854 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-2f37c4e6-a584-4d6b-9bce-9f497ea863fd tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] [instance: bcf45146-f982-459d-96c0-e7af402962e9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='31affc49-b6f0-44da-af65-4c65d72458b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116272) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 22 12:21:41.796190 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-2f37c4e6-a584-4d6b-9bce-9f497ea863fd tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.614302 Nov 22 12:21:41.796900 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 268/517] 10.222.0.66 () {60 vars in 1146 bytes} [Mon Nov 22 12:21:41 2021] POST /compute/v2.1/servers => generated 380 bytes in 616 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 22 12:21:41.807907 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-4e245525-e841-46d3-ba5f-57fb70fde3a6 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:21:41.808867 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-4e245525-e841-46d3-ba5f-57fb70fde3a6 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] [instance: bcf45146-f982-459d-96c0-e7af402962e9] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:41.901253 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-4e245525-e841-46d3-ba5f-57fb70fde3a6 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b581fa25045cea9585ae4e707585d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5319fd2dee9b4b47b98f59bca1572ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:21:41.910564 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-4e245525-e841-46d3-ba5f-57fb70fde3a6 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] 10.222.0.66 "GET /compute/v2.1/servers/bcf45146-f982-459d-96c0-e7af402962e9" status: 200 len: 1218 microversion: 2.1 time: 0.106936 Nov 22 12:21:41.911149 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 269/518] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:21:41 2021] GET /compute/v2.1/servers/bcf45146-f982-459d-96c0-e7af402962e9 => generated 1218 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 12:21:41.939333 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-f5b03f04-558d-43bd-afbe-4a6e01d36b57 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8989f156c213442795edd8b9195bcbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad46aac0327b4760bef46d579031abd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:21:41.947684 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-f5b03f04-558d-43bd-afbe-4a6e01d36b57 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] 10.222.0.66 "GET /compute/v2.1/servers/049121a2-b87d-4df0-ab75-a4d346f27d22" status: 200 len: 1314 microversion: 2.1 time: 0.248194 Nov 22 12:21:41.948592 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 250/519] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:21:41 2021] GET /compute/v2.1/servers/049121a2-b87d-4df0-ab75-a4d346f27d22 => generated 1314 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 12:21:42.042264 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-ebade750-401d-4a54-a689-7873e624bbf3 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:21:42.043296 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-ebade750-401d-4a54-a689-7873e624bbf3 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: 2306113c-8f98-42fd-8c0c-3dfac98fff21] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:42.052942 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-ebade750-401d-4a54-a689-7873e624bbf3 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:42.053219 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-ebade750-401d-4a54-a689-7873e624bbf3 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:42.054473 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-ebade750-401d-4a54-a689-7873e624bbf3 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:42.054906 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-ebade750-401d-4a54-a689-7873e624bbf3 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:42.928412 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-a0a59e62-1b89-4e75-a83c-e529badd4ffd tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:21:42.929029 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-a0a59e62-1b89-4e75-a83c-e529badd4ffd tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] [instance: bcf45146-f982-459d-96c0-e7af402962e9] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:42.936607 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-a0a59e62-1b89-4e75-a83c-e529badd4ffd tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:42.937268 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-a0a59e62-1b89-4e75-a83c-e529badd4ffd tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:42.938237 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-a0a59e62-1b89-4e75-a83c-e529badd4ffd tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:42.938950 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-a0a59e62-1b89-4e75-a83c-e529badd4ffd tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:43.003656 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-a0a59e62-1b89-4e75-a83c-e529badd4ffd tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b581fa25045cea9585ae4e707585d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5319fd2dee9b4b47b98f59bca1572ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:21:43.015392 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-a0a59e62-1b89-4e75-a83c-e529badd4ffd tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] 10.222.0.66 "GET /compute/v2.1/servers/bcf45146-f982-459d-96c0-e7af402962e9" status: 200 len: 1222 microversion: 2.1 time: 0.090586 Nov 22 12:21:43.015978 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 251/520] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:21:42 2021] GET /compute/v2.1/servers/bcf45146-f982-459d-96c0-e7af402962e9 => generated 1222 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:21:43.020291 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-c4320d85-5005-4336-b2da-1b0b9a6179ac tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:21:43.020884 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-c4320d85-5005-4336-b2da-1b0b9a6179ac tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] [instance: 049121a2-b87d-4df0-ab75-a4d346f27d22] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:43.026977 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-c4320d85-5005-4336-b2da-1b0b9a6179ac tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:43.027502 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-c4320d85-5005-4336-b2da-1b0b9a6179ac tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:43.028418 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-c4320d85-5005-4336-b2da-1b0b9a6179ac tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:43.028848 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-c4320d85-5005-4336-b2da-1b0b9a6179ac tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:43.173834 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-c4320d85-5005-4336-b2da-1b0b9a6179ac tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8989f156c213442795edd8b9195bcbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad46aac0327b4760bef46d579031abd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:21:43.181595 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-c4320d85-5005-4336-b2da-1b0b9a6179ac tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] 10.222.0.66 "GET /compute/v2.1/servers/049121a2-b87d-4df0-ab75-a4d346f27d22" status: 200 len: 1314 microversion: 2.1 time: 0.164653 Nov 22 12:21:43.182160 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 252/521] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:21:43 2021] GET /compute/v2.1/servers/049121a2-b87d-4df0-ab75-a4d346f27d22 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:21:44.032825 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-ba6cd10c-4284-4821-8cd2-a3b6c4969b40 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:21:44.033472 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-ba6cd10c-4284-4821-8cd2-a3b6c4969b40 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] [instance: bcf45146-f982-459d-96c0-e7af402962e9] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:44.041021 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-ba6cd10c-4284-4821-8cd2-a3b6c4969b40 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:44.041462 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-ba6cd10c-4284-4821-8cd2-a3b6c4969b40 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:44.042242 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-ba6cd10c-4284-4821-8cd2-a3b6c4969b40 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:44.042642 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-ba6cd10c-4284-4821-8cd2-a3b6c4969b40 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:44.107693 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-ba6cd10c-4284-4821-8cd2-a3b6c4969b40 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b581fa25045cea9585ae4e707585d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5319fd2dee9b4b47b98f59bca1572ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:21:44.115969 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-ba6cd10c-4284-4821-8cd2-a3b6c4969b40 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] 10.222.0.66 "GET /compute/v2.1/servers/bcf45146-f982-459d-96c0-e7af402962e9" status: 200 len: 1222 microversion: 2.1 time: 0.087195 Nov 22 12:21:44.116582 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 253/522] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:21:44 2021] GET /compute/v2.1/servers/bcf45146-f982-459d-96c0-e7af402962e9 => generated 1222 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:21:44.201596 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-7a5cc9bf-4012-46b0-8d83-4dbcf6231864 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:21:44.202193 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-7a5cc9bf-4012-46b0-8d83-4dbcf6231864 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] [instance: 049121a2-b87d-4df0-ab75-a4d346f27d22] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:44.208839 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-7a5cc9bf-4012-46b0-8d83-4dbcf6231864 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:44.209290 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-7a5cc9bf-4012-46b0-8d83-4dbcf6231864 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:44.210086 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-7a5cc9bf-4012-46b0-8d83-4dbcf6231864 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:44.210519 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-7a5cc9bf-4012-46b0-8d83-4dbcf6231864 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:44.351706 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-7a5cc9bf-4012-46b0-8d83-4dbcf6231864 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8989f156c213442795edd8b9195bcbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad46aac0327b4760bef46d579031abd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:21:44.360794 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-7a5cc9bf-4012-46b0-8d83-4dbcf6231864 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] 10.222.0.66 "GET /compute/v2.1/servers/049121a2-b87d-4df0-ab75-a4d346f27d22" status: 200 len: 1314 microversion: 2.1 time: 0.163907 Nov 22 12:21:44.361600 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 254/523] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:21:44 2021] GET /compute/v2.1/servers/049121a2-b87d-4df0-ab75-a4d346f27d22 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:21:44.547020 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-ebade750-401d-4a54-a689-7873e624bbf3 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "POST /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21/action" status: 200 len: 27524 microversion: 2.1 time: 2.518216 Nov 22 12:21:44.549228 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 270/524] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Nov 22 12:21:42 2021] POST /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21/action => generated 27524 bytes in 2521 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 12:21:45.060056 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-a1d60213-8450-4507-8f54-86ca6f24d778 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:21:45.060859 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-a1d60213-8450-4507-8f54-86ca6f24d778 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: c9f6d441-246f-479e-8e88-ea701c0f87ff] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:45.067318 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-a1d60213-8450-4507-8f54-86ca6f24d778 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:45.067807 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-a1d60213-8450-4507-8f54-86ca6f24d778 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:45.068595 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-a1d60213-8450-4507-8f54-86ca6f24d778 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:45.069022 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-a1d60213-8450-4507-8f54-86ca6f24d778 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:45.093123 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.objects.instance [None req-a1d60213-8450-4507-8f54-86ca6f24d778 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lazy-loading 'flavor' on Instance uuid c9f6d441-246f-479e-8e88-ea701c0f87ff {{(pid=116273) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 22 12:21:45.137010 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-abe294da-62f3-42f9-a014-f847e6bd1aad tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:21:45.138427 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-abe294da-62f3-42f9-a014-f847e6bd1aad tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] [instance: bcf45146-f982-459d-96c0-e7af402962e9] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:45.151873 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-abe294da-62f3-42f9-a014-f847e6bd1aad tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:45.152240 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-abe294da-62f3-42f9-a014-f847e6bd1aad tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:45.153986 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-abe294da-62f3-42f9-a014-f847e6bd1aad tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:45.154331 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-abe294da-62f3-42f9-a014-f847e6bd1aad tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:45.239405 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-abe294da-62f3-42f9-a014-f847e6bd1aad tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b581fa25045cea9585ae4e707585d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5319fd2dee9b4b47b98f59bca1572ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:21:45.248253 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-abe294da-62f3-42f9-a014-f847e6bd1aad tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] 10.222.0.66 "GET /compute/v2.1/servers/bcf45146-f982-459d-96c0-e7af402962e9" status: 200 len: 1270 microversion: 2.1 time: 0.116809 Nov 22 12:21:45.248784 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 271/525] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:21:45 2021] GET /compute/v2.1/servers/bcf45146-f982-459d-96c0-e7af402962e9 => generated 1270 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:21:45.379161 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-0a1b52c6-c8eb-4617-b1f5-3f411fbc0350 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:21:45.379917 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-0a1b52c6-c8eb-4617-b1f5-3f411fbc0350 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] [instance: 049121a2-b87d-4df0-ab75-a4d346f27d22] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:45.389443 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-0a1b52c6-c8eb-4617-b1f5-3f411fbc0350 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:45.390121 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-0a1b52c6-c8eb-4617-b1f5-3f411fbc0350 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:45.390858 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-0a1b52c6-c8eb-4617-b1f5-3f411fbc0350 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:45.391414 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-0a1b52c6-c8eb-4617-b1f5-3f411fbc0350 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:45.469816 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-a1d60213-8450-4507-8f54-86ca6f24d778 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "POST /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff/action" status: 202 len: 0 microversion: 2.20 time: 0.412985 Nov 22 12:21:45.485475 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 255/526] 10.222.0.66 () {62 vars in 1318 bytes} [Mon Nov 22 12:21:45 2021] POST /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff/action => generated 0 bytes in 430 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 22 12:21:45.493449 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-eb9a9789-78dd-42a7-a77c-d063ea2edd65 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:21:45.495049 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-eb9a9789-78dd-42a7-a77c-d063ea2edd65 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: c9f6d441-246f-479e-8e88-ea701c0f87ff] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:45.507243 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-eb9a9789-78dd-42a7-a77c-d063ea2edd65 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:45.511027 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-eb9a9789-78dd-42a7-a77c-d063ea2edd65 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:45.512875 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-eb9a9789-78dd-42a7-a77c-d063ea2edd65 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:45.514029 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-eb9a9789-78dd-42a7-a77c-d063ea2edd65 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:45.630298 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-0a1b52c6-c8eb-4617-b1f5-3f411fbc0350 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8989f156c213442795edd8b9195bcbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad46aac0327b4760bef46d579031abd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:21:45.644059 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-0a1b52c6-c8eb-4617-b1f5-3f411fbc0350 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] 10.222.0.66 "GET /compute/v2.1/servers/049121a2-b87d-4df0-ab75-a4d346f27d22" status: 200 len: 1314 microversion: 2.1 time: 0.268447 Nov 22 12:21:45.646756 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 272/527] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:21:45 2021] GET /compute/v2.1/servers/049121a2-b87d-4df0-ab75-a4d346f27d22 => generated 1314 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 12:21:45.651809 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-b418f941-3e78-467f-9cd9-a7a83fa0c38f tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:21:45.653209 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-b418f941-3e78-467f-9cd9-a7a83fa0c38f tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: 2306113c-8f98-42fd-8c0c-3dfac98fff21] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:45.659813 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-b418f941-3e78-467f-9cd9-a7a83fa0c38f tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:45.660688 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-b418f941-3e78-467f-9cd9-a7a83fa0c38f tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:45.662290 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-b418f941-3e78-467f-9cd9-a7a83fa0c38f tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:45.663085 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-b418f941-3e78-467f-9cd9-a7a83fa0c38f tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:45.706475 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-eb9a9789-78dd-42a7-a77c-d063ea2edd65 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:21:45.714899 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-eb9a9789-78dd-42a7-a77c-d063ea2edd65 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:21:45.716870 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-eb9a9789-78dd-42a7-a77c-d063ea2edd65 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:21:45.718422 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-eb9a9789-78dd-42a7-a77c-d063ea2edd65 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff" status: 200 len: 1724 microversion: 2.20 time: 0.231133 Nov 22 12:21:45.718983 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 256/528] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Nov 22 12:21:45 2021] GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff => generated 1724 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 12:21:45.808310 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-b418f941-3e78-467f-9cd9-a7a83fa0c38f tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "POST /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21/action" status: 200 len: 27715 microversion: 2.1 time: 0.159910 Nov 22 12:21:45.809737 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 273/529] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Nov 22 12:21:45 2021] POST /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21/action => generated 27715 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 12:21:46.276540 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-e6dbc587-b036-4fef-a40a-6e37f8fce7e5 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:21:46.278524 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-e6dbc587-b036-4fef-a40a-6e37f8fce7e5 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] [instance: bcf45146-f982-459d-96c0-e7af402962e9] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:46.286378 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-e6dbc587-b036-4fef-a40a-6e37f8fce7e5 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:46.287455 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-e6dbc587-b036-4fef-a40a-6e37f8fce7e5 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:46.288514 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-e6dbc587-b036-4fef-a40a-6e37f8fce7e5 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:46.289168 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-e6dbc587-b036-4fef-a40a-6e37f8fce7e5 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:46.458386 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-e6dbc587-b036-4fef-a40a-6e37f8fce7e5 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b581fa25045cea9585ae4e707585d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5319fd2dee9b4b47b98f59bca1572ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:21:46.468109 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-e6dbc587-b036-4fef-a40a-6e37f8fce7e5 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] 10.222.0.66 "GET /compute/v2.1/servers/bcf45146-f982-459d-96c0-e7af402962e9" status: 200 len: 1318 microversion: 2.1 time: 0.197728 Nov 22 12:21:46.479418 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 257/530] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:21:46 2021] GET /compute/v2.1/servers/bcf45146-f982-459d-96c0-e7af402962e9 => generated 1318 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:21:46.665262 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-cabab489-8dbf-46b2-a93d-d60f94e2dbdd tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:21:46.665857 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-cabab489-8dbf-46b2-a93d-d60f94e2dbdd tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] [instance: 049121a2-b87d-4df0-ab75-a4d346f27d22] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:46.678125 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-cabab489-8dbf-46b2-a93d-d60f94e2dbdd tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:46.678586 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-cabab489-8dbf-46b2-a93d-d60f94e2dbdd tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:46.679436 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-cabab489-8dbf-46b2-a93d-d60f94e2dbdd tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:46.679876 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-cabab489-8dbf-46b2-a93d-d60f94e2dbdd tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:46.738023 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-f5a0e1d5-3619-415e-953c-6d809b9dad63 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:21:46.738662 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-f5a0e1d5-3619-415e-953c-6d809b9dad63 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: c9f6d441-246f-479e-8e88-ea701c0f87ff] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:46.745955 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-f5a0e1d5-3619-415e-953c-6d809b9dad63 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:46.751125 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-f5a0e1d5-3619-415e-953c-6d809b9dad63 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:46.752146 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-f5a0e1d5-3619-415e-953c-6d809b9dad63 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:46.752597 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-f5a0e1d5-3619-415e-953c-6d809b9dad63 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:46.987882 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-cabab489-8dbf-46b2-a93d-d60f94e2dbdd tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8989f156c213442795edd8b9195bcbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad46aac0327b4760bef46d579031abd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:21:46.999525 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-cabab489-8dbf-46b2-a93d-d60f94e2dbdd tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] 10.222.0.66 "GET /compute/v2.1/servers/049121a2-b87d-4df0-ab75-a4d346f27d22" status: 200 len: 1314 microversion: 2.1 time: 0.339164 Nov 22 12:21:47.015799 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 274/531] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:21:46 2021] GET /compute/v2.1/servers/049121a2-b87d-4df0-ab75-a4d346f27d22 => generated 1314 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:21:47.024209 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-327bdeb1-690f-42c3-9371-0824cd4d082e tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:21:47.025639 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-327bdeb1-690f-42c3-9371-0824cd4d082e tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: 2306113c-8f98-42fd-8c0c-3dfac98fff21] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:47.032244 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-327bdeb1-690f-42c3-9371-0824cd4d082e tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:47.032826 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-327bdeb1-690f-42c3-9371-0824cd4d082e tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:47.033824 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-327bdeb1-690f-42c3-9371-0824cd4d082e tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:47.034435 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-327bdeb1-690f-42c3-9371-0824cd4d082e tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:47.072874 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-f5a0e1d5-3619-415e-953c-6d809b9dad63 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:21:47.082200 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-f5a0e1d5-3619-415e-953c-6d809b9dad63 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:21:47.084051 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-f5a0e1d5-3619-415e-953c-6d809b9dad63 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:21:47.085623 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-f5a0e1d5-3619-415e-953c-6d809b9dad63 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff" status: 200 len: 1724 microversion: 2.20 time: 0.351719 Nov 22 12:21:47.086517 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 258/532] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Nov 22 12:21:46 2021] GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff => generated 1724 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 12:21:47.091594 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [req-72117e89-5f07-4201-8969-d222d111ab65 req-b67e026f-44ff-4b27-9acf-6b75c40fdce6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "049121a2-b87d-4df0-ab75-a4d346f27d22", "name": "network-vif-plugged", "status": "completed", "tag": "a4b96091-b3aa-436d-a620-de83c69919aa"}]} {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:21:47.093478 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 12:21:47.093478 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: warnings.warn(msg) Nov 22 12:21:47.102545 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [req-72117e89-5f07-4201-8969-d222d111ab65 req-b67e026f-44ff-4b27-9acf-6b75c40fdce6 service nova] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:47.103306 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [req-72117e89-5f07-4201-8969-d222d111ab65 req-b67e026f-44ff-4b27-9acf-6b75c40fdce6 service nova] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:47.127054 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.compute.server_external_events [req-72117e89-5f07-4201-8969-d222d111ab65 req-b67e026f-44ff-4b27-9acf-6b75c40fdce6 service nova] Creating event network-vif-plugged:a4b96091-b3aa-436d-a620-de83c69919aa for instance 049121a2-b87d-4df0-ab75-a4d346f27d22 on hv-cinder-76845 Nov 22 12:21:47.137447 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [req-72117e89-5f07-4201-8969-d222d111ab65 req-b67e026f-44ff-4b27-9acf-6b75c40fdce6 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049187 Nov 22 12:21:47.138340 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 259/533] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Nov 22 12:21:47 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 12:21:47.487688 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-2abc507b-4a2b-4976-8bd4-848eba9365f3 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:21:47.489941 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-2abc507b-4a2b-4976-8bd4-848eba9365f3 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] [instance: bcf45146-f982-459d-96c0-e7af402962e9] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:47.501655 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-2abc507b-4a2b-4976-8bd4-848eba9365f3 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:47.502100 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-2abc507b-4a2b-4976-8bd4-848eba9365f3 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:47.502901 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-2abc507b-4a2b-4976-8bd4-848eba9365f3 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:47.503366 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-2abc507b-4a2b-4976-8bd4-848eba9365f3 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:47.653158 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-2abc507b-4a2b-4976-8bd4-848eba9365f3 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b581fa25045cea9585ae4e707585d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5319fd2dee9b4b47b98f59bca1572ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:21:47.664402 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-2abc507b-4a2b-4976-8bd4-848eba9365f3 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] 10.222.0.66 "GET /compute/v2.1/servers/bcf45146-f982-459d-96c0-e7af402962e9" status: 200 len: 1318 microversion: 2.1 time: 0.181661 Nov 22 12:21:47.665035 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 260/534] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:21:47 2021] GET /compute/v2.1/servers/bcf45146-f982-459d-96c0-e7af402962e9 => generated 1318 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 12:21:47.670049 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [req-5ff0fb18-ab9f-434b-8d58-f15a956a1c8b req-1dd1bad9-52d3-4a56-bd05-9d7ef364a864 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bcf45146-f982-459d-96c0-e7af402962e9", "tag": "34ab8e79-23fc-4427-bf02-045bf7c07481"}]} {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:21:47.671621 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 12:21:47.671621 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: warnings.warn(msg) Nov 22 12:21:47.679691 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [req-5ff0fb18-ab9f-434b-8d58-f15a956a1c8b req-1dd1bad9-52d3-4a56-bd05-9d7ef364a864 service nova] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:47.680153 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [req-5ff0fb18-ab9f-434b-8d58-f15a956a1c8b req-1dd1bad9-52d3-4a56-bd05-9d7ef364a864 service nova] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:47.694233 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.compute.server_external_events [req-5ff0fb18-ab9f-434b-8d58-f15a956a1c8b req-1dd1bad9-52d3-4a56-bd05-9d7ef364a864 service nova] Creating event network-changed:34ab8e79-23fc-4427-bf02-045bf7c07481 for instance bcf45146-f982-459d-96c0-e7af402962e9 on hv-cinder-76845 Nov 22 12:21:47.700528 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [req-5ff0fb18-ab9f-434b-8d58-f15a956a1c8b req-1dd1bad9-52d3-4a56-bd05-9d7ef364a864 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033764 Nov 22 12:21:47.701799 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 261/535] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Nov 22 12:21:47 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 12:21:48.022894 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-f3ef2ec4-af7f-4339-8c01-02bf04eb21ca tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:21:48.023530 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-f3ef2ec4-af7f-4339-8c01-02bf04eb21ca tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] [instance: 049121a2-b87d-4df0-ab75-a4d346f27d22] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:48.030425 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-f3ef2ec4-af7f-4339-8c01-02bf04eb21ca tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:48.030877 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-f3ef2ec4-af7f-4339-8c01-02bf04eb21ca tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:48.031701 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-f3ef2ec4-af7f-4339-8c01-02bf04eb21ca tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:48.032127 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-f3ef2ec4-af7f-4339-8c01-02bf04eb21ca tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:48.168030 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-f3ef2ec4-af7f-4339-8c01-02bf04eb21ca tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8989f156c213442795edd8b9195bcbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad46aac0327b4760bef46d579031abd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:21:48.175886 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-f3ef2ec4-af7f-4339-8c01-02bf04eb21ca tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] 10.222.0.66 "GET /compute/v2.1/servers/049121a2-b87d-4df0-ab75-a4d346f27d22" status: 200 len: 1314 microversion: 2.1 time: 0.157232 Nov 22 12:21:48.176475 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 262/536] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:21:48 2021] GET /compute/v2.1/servers/049121a2-b87d-4df0-ab75-a4d346f27d22 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:21:48.180796 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-4a0898a3-553e-464b-8cd4-da87b58110ae tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:21:48.181387 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-4a0898a3-553e-464b-8cd4-da87b58110ae tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: c9f6d441-246f-479e-8e88-ea701c0f87ff] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:48.187799 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-4a0898a3-553e-464b-8cd4-da87b58110ae tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:48.188261 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-4a0898a3-553e-464b-8cd4-da87b58110ae tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:48.189040 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-4a0898a3-553e-464b-8cd4-da87b58110ae tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:48.189475 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-4a0898a3-553e-464b-8cd4-da87b58110ae tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:48.326448 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-4a0898a3-553e-464b-8cd4-da87b58110ae tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:21:48.335160 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-4a0898a3-553e-464b-8cd4-da87b58110ae tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:21:48.336700 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-4a0898a3-553e-464b-8cd4-da87b58110ae tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:21:48.337901 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-4a0898a3-553e-464b-8cd4-da87b58110ae tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff" status: 200 len: 1724 microversion: 2.20 time: 0.160494 Nov 22 12:21:48.338488 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 263/537] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Nov 22 12:21:48 2021] GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 12:21:48.681829 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-bfe3bccc-cde1-4d59-b72c-44722bbd4437 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:21:48.682444 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-bfe3bccc-cde1-4d59-b72c-44722bbd4437 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] [instance: bcf45146-f982-459d-96c0-e7af402962e9] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:48.689717 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-bfe3bccc-cde1-4d59-b72c-44722bbd4437 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:48.690173 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-bfe3bccc-cde1-4d59-b72c-44722bbd4437 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:48.690952 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-bfe3bccc-cde1-4d59-b72c-44722bbd4437 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:48.691422 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-bfe3bccc-cde1-4d59-b72c-44722bbd4437 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:48.852291 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-bfe3bccc-cde1-4d59-b72c-44722bbd4437 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b581fa25045cea9585ae4e707585d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5319fd2dee9b4b47b98f59bca1572ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:21:48.863343 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-bfe3bccc-cde1-4d59-b72c-44722bbd4437 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] 10.222.0.66 "GET /compute/v2.1/servers/bcf45146-f982-459d-96c0-e7af402962e9" status: 200 len: 1318 microversion: 2.1 time: 0.184860 Nov 22 12:21:48.863939 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 264/538] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:21:48 2021] GET /compute/v2.1/servers/bcf45146-f982-459d-96c0-e7af402962e9 => generated 1318 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:21:49.193893 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-bc4b6706-c974-4b53-ab79-dcffa216d113 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:21:49.194536 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-bc4b6706-c974-4b53-ab79-dcffa216d113 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] [instance: 049121a2-b87d-4df0-ab75-a4d346f27d22] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:49.201638 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-bc4b6706-c974-4b53-ab79-dcffa216d113 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:49.203335 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-bc4b6706-c974-4b53-ab79-dcffa216d113 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:49.203335 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-bc4b6706-c974-4b53-ab79-dcffa216d113 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:49.203335 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-bc4b6706-c974-4b53-ab79-dcffa216d113 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:49.343454 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-bc4b6706-c974-4b53-ab79-dcffa216d113 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8989f156c213442795edd8b9195bcbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad46aac0327b4760bef46d579031abd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:21:49.351380 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-bc4b6706-c974-4b53-ab79-dcffa216d113 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] 10.222.0.66 "GET /compute/v2.1/servers/049121a2-b87d-4df0-ab75-a4d346f27d22" status: 200 len: 1314 microversion: 2.1 time: 0.161155 Nov 22 12:21:49.352060 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 265/539] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:21:49 2021] GET /compute/v2.1/servers/049121a2-b87d-4df0-ab75-a4d346f27d22 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:21:49.357211 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-6a8409dd-61fe-4fd8-9a2c-a1b513475e35 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:21:49.357809 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-6a8409dd-61fe-4fd8-9a2c-a1b513475e35 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: c9f6d441-246f-479e-8e88-ea701c0f87ff] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:49.363907 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-6a8409dd-61fe-4fd8-9a2c-a1b513475e35 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:49.364346 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-6a8409dd-61fe-4fd8-9a2c-a1b513475e35 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:49.365129 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-6a8409dd-61fe-4fd8-9a2c-a1b513475e35 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:49.365555 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-6a8409dd-61fe-4fd8-9a2c-a1b513475e35 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:49.728470 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-6a8409dd-61fe-4fd8-9a2c-a1b513475e35 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:21:49.736678 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-6a8409dd-61fe-4fd8-9a2c-a1b513475e35 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:21:49.738165 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-6a8409dd-61fe-4fd8-9a2c-a1b513475e35 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:21:49.739344 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-6a8409dd-61fe-4fd8-9a2c-a1b513475e35 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff" status: 200 len: 1724 microversion: 2.20 time: 0.386307 Nov 22 12:21:49.739897 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 266/540] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Nov 22 12:21:49 2021] GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff => generated 1724 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 12:21:49.880800 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-8ab4666c-86f8-43b1-a818-e945b1853432 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:21:49.881405 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-8ab4666c-86f8-43b1-a818-e945b1853432 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] [instance: bcf45146-f982-459d-96c0-e7af402962e9] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:49.887426 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-8ab4666c-86f8-43b1-a818-e945b1853432 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:49.887870 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-8ab4666c-86f8-43b1-a818-e945b1853432 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:49.888644 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-8ab4666c-86f8-43b1-a818-e945b1853432 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:49.889066 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-8ab4666c-86f8-43b1-a818-e945b1853432 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:50.041628 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-8ab4666c-86f8-43b1-a818-e945b1853432 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b581fa25045cea9585ae4e707585d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5319fd2dee9b4b47b98f59bca1572ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:21:50.049470 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-8ab4666c-86f8-43b1-a818-e945b1853432 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] 10.222.0.66 "GET /compute/v2.1/servers/bcf45146-f982-459d-96c0-e7af402962e9" status: 200 len: 1318 microversion: 2.1 time: 0.172287 Nov 22 12:21:50.050040 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 267/541] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:21:49 2021] GET /compute/v2.1/servers/bcf45146-f982-459d-96c0-e7af402962e9 => generated 1318 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:21:50.188029 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-327bdeb1-690f-42c3-9371-0824cd4d082e tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "POST /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21/action" status: 200 len: 28184 microversion: 2.1 time: 3.170849 Nov 22 12:21:50.188603 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 275/542] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Nov 22 12:21:47 2021] POST /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21/action => generated 28184 bytes in 3172 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 12:21:50.369142 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-8a7177cb-2387-44ee-86f8-2d6617607266 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:21:50.369896 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-8a7177cb-2387-44ee-86f8-2d6617607266 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] [instance: 049121a2-b87d-4df0-ab75-a4d346f27d22] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:50.376262 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-8a7177cb-2387-44ee-86f8-2d6617607266 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:50.376711 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-8a7177cb-2387-44ee-86f8-2d6617607266 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:50.377505 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-8a7177cb-2387-44ee-86f8-2d6617607266 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:50.377945 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-8a7177cb-2387-44ee-86f8-2d6617607266 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:50.522204 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-8a7177cb-2387-44ee-86f8-2d6617607266 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8989f156c213442795edd8b9195bcbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad46aac0327b4760bef46d579031abd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:21:50.530363 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-8a7177cb-2387-44ee-86f8-2d6617607266 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] 10.222.0.66 "GET /compute/v2.1/servers/049121a2-b87d-4df0-ab75-a4d346f27d22" status: 200 len: 1314 microversion: 2.1 time: 0.164988 Nov 22 12:21:50.530968 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 268/543] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:21:50 2021] GET /compute/v2.1/servers/049121a2-b87d-4df0-ab75-a4d346f27d22 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:21:50.767214 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-edaaa44a-52b7-4ea5-b82f-dae02f75c04f tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:21:50.767948 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-edaaa44a-52b7-4ea5-b82f-dae02f75c04f tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: c9f6d441-246f-479e-8e88-ea701c0f87ff] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:50.781144 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-edaaa44a-52b7-4ea5-b82f-dae02f75c04f tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:50.782218 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-edaaa44a-52b7-4ea5-b82f-dae02f75c04f tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:50.783696 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-edaaa44a-52b7-4ea5-b82f-dae02f75c04f tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:50.784282 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-edaaa44a-52b7-4ea5-b82f-dae02f75c04f tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:50.954460 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-edaaa44a-52b7-4ea5-b82f-dae02f75c04f tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:21:50.962373 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-edaaa44a-52b7-4ea5-b82f-dae02f75c04f tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:21:50.963937 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-edaaa44a-52b7-4ea5-b82f-dae02f75c04f tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:21:50.965248 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-edaaa44a-52b7-4ea5-b82f-dae02f75c04f tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff" status: 200 len: 1724 microversion: 2.20 time: 0.209552 Nov 22 12:21:50.965822 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 276/544] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Nov 22 12:21:50 2021] GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff => generated 1724 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 12:21:51.066506 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-a6282f2f-be45-4898-8ee2-fa957a0cd36d tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:21:51.067104 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-a6282f2f-be45-4898-8ee2-fa957a0cd36d tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] [instance: bcf45146-f982-459d-96c0-e7af402962e9] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:51.074697 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-a6282f2f-be45-4898-8ee2-fa957a0cd36d tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:51.075589 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-a6282f2f-be45-4898-8ee2-fa957a0cd36d tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:51.076381 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-a6282f2f-be45-4898-8ee2-fa957a0cd36d tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:51.077030 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-a6282f2f-be45-4898-8ee2-fa957a0cd36d tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:51.202118 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-a32eee1a-207e-4b90-acb1-6aca12767c25 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:21:51.203870 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-a32eee1a-207e-4b90-acb1-6aca12767c25 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: 2306113c-8f98-42fd-8c0c-3dfac98fff21] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:51.210609 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-a32eee1a-207e-4b90-acb1-6aca12767c25 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:51.211299 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-a32eee1a-207e-4b90-acb1-6aca12767c25 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:51.212454 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-a32eee1a-207e-4b90-acb1-6aca12767c25 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:51.213172 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-a32eee1a-207e-4b90-acb1-6aca12767c25 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:51.217605 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-a6282f2f-be45-4898-8ee2-fa957a0cd36d tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b581fa25045cea9585ae4e707585d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5319fd2dee9b4b47b98f59bca1572ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:21:51.225016 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-a6282f2f-be45-4898-8ee2-fa957a0cd36d tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] 10.222.0.66 "GET /compute/v2.1/servers/bcf45146-f982-459d-96c0-e7af402962e9" status: 200 len: 1318 microversion: 2.1 time: 0.162534 Nov 22 12:21:51.225594 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 269/545] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:21:51 2021] GET /compute/v2.1/servers/bcf45146-f982-459d-96c0-e7af402962e9 => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:21:51.326844 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-a32eee1a-207e-4b90-acb1-6aca12767c25 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "POST /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21/action" status: 200 len: 28184 microversion: 2.1 time: 0.130196 Nov 22 12:21:51.327616 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 277/546] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Nov 22 12:21:51 2021] POST /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21/action => generated 28184 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 12:21:51.548072 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-08d09db7-6dd4-49e6-92d6-c11424edd45d tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:21:51.548695 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-08d09db7-6dd4-49e6-92d6-c11424edd45d tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] [instance: 049121a2-b87d-4df0-ab75-a4d346f27d22] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:51.555494 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-08d09db7-6dd4-49e6-92d6-c11424edd45d tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:51.555960 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-08d09db7-6dd4-49e6-92d6-c11424edd45d tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:51.556759 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-08d09db7-6dd4-49e6-92d6-c11424edd45d tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:51.557163 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-08d09db7-6dd4-49e6-92d6-c11424edd45d tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:51.705739 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-08d09db7-6dd4-49e6-92d6-c11424edd45d tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8989f156c213442795edd8b9195bcbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad46aac0327b4760bef46d579031abd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:21:51.713547 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-08d09db7-6dd4-49e6-92d6-c11424edd45d tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] 10.222.0.66 "GET /compute/v2.1/servers/049121a2-b87d-4df0-ab75-a4d346f27d22" status: 200 len: 1314 microversion: 2.1 time: 0.169311 Nov 22 12:21:51.714089 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 270/547] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:21:51 2021] GET /compute/v2.1/servers/049121a2-b87d-4df0-ab75-a4d346f27d22 => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 12:21:51.984114 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-820ca56e-d1cb-434b-b4fa-a79bff2dc2b1 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:21:51.984882 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-820ca56e-d1cb-434b-b4fa-a79bff2dc2b1 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: c9f6d441-246f-479e-8e88-ea701c0f87ff] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:51.997808 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-820ca56e-d1cb-434b-b4fa-a79bff2dc2b1 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:51.998258 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-820ca56e-d1cb-434b-b4fa-a79bff2dc2b1 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:51.999137 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-820ca56e-d1cb-434b-b4fa-a79bff2dc2b1 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:51.999602 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-820ca56e-d1cb-434b-b4fa-a79bff2dc2b1 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:52.148256 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-820ca56e-d1cb-434b-b4fa-a79bff2dc2b1 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:21:52.159702 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-820ca56e-d1cb-434b-b4fa-a79bff2dc2b1 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:21:52.161776 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-820ca56e-d1cb-434b-b4fa-a79bff2dc2b1 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:21:52.164761 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-820ca56e-d1cb-434b-b4fa-a79bff2dc2b1 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff" status: 200 len: 1724 microversion: 2.20 time: 0.183172 Nov 22 12:21:52.175257 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 278/548] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Nov 22 12:21:51 2021] GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff => generated 1724 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 22 12:21:52.242415 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-eb25d160-8f1a-4b8d-8760-3bec79ce32fb tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:21:52.243061 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-eb25d160-8f1a-4b8d-8760-3bec79ce32fb tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] [instance: bcf45146-f982-459d-96c0-e7af402962e9] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:52.251820 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-eb25d160-8f1a-4b8d-8760-3bec79ce32fb tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:52.252726 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-eb25d160-8f1a-4b8d-8760-3bec79ce32fb tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:52.254111 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-eb25d160-8f1a-4b8d-8760-3bec79ce32fb tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:52.255277 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-eb25d160-8f1a-4b8d-8760-3bec79ce32fb tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:52.341518 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-cc2eb7f8-3fc9-4991-aaed-3d420770f1db tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:21:52.341518 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-cc2eb7f8-3fc9-4991-aaed-3d420770f1db tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: 2306113c-8f98-42fd-8c0c-3dfac98fff21] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:52.348015 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-cc2eb7f8-3fc9-4991-aaed-3d420770f1db tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:52.348558 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-cc2eb7f8-3fc9-4991-aaed-3d420770f1db tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:52.349434 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-cc2eb7f8-3fc9-4991-aaed-3d420770f1db tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:52.350290 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-cc2eb7f8-3fc9-4991-aaed-3d420770f1db tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:52.440471 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-eb25d160-8f1a-4b8d-8760-3bec79ce32fb tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b581fa25045cea9585ae4e707585d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5319fd2dee9b4b47b98f59bca1572ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:21:52.441511 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-cc2eb7f8-3fc9-4991-aaed-3d420770f1db tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "POST /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21/action" status: 200 len: 28184 microversion: 2.1 time: 0.105873 Nov 22 12:21:52.445514 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 279/549] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Nov 22 12:21:52 2021] POST /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21/action => generated 28184 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 22 12:21:52.448452 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-eb25d160-8f1a-4b8d-8760-3bec79ce32fb tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] 10.222.0.66 "GET /compute/v2.1/servers/bcf45146-f982-459d-96c0-e7af402962e9" status: 200 len: 1318 microversion: 2.1 time: 0.210347 Nov 22 12:21:52.449341 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 271/550] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:21:52 2021] GET /compute/v2.1/servers/bcf45146-f982-459d-96c0-e7af402962e9 => generated 1318 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:21:52.731017 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-2f38352c-d968-4c09-bdc1-afc779260089 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:21:52.731797 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-2f38352c-d968-4c09-bdc1-afc779260089 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] [instance: 049121a2-b87d-4df0-ab75-a4d346f27d22] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:52.739294 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-2f38352c-d968-4c09-bdc1-afc779260089 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:52.739739 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-2f38352c-d968-4c09-bdc1-afc779260089 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:52.740561 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-2f38352c-d968-4c09-bdc1-afc779260089 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:52.741022 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-2f38352c-d968-4c09-bdc1-afc779260089 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:52.893825 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-2f38352c-d968-4c09-bdc1-afc779260089 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8989f156c213442795edd8b9195bcbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad46aac0327b4760bef46d579031abd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:21:52.903345 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-2f38352c-d968-4c09-bdc1-afc779260089 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] 10.222.0.66 "GET /compute/v2.1/servers/049121a2-b87d-4df0-ab75-a4d346f27d22" status: 200 len: 1498 microversion: 2.1 time: 0.176462 Nov 22 12:21:52.904559 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 280/551] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:21:52 2021] GET /compute/v2.1/servers/049121a2-b87d-4df0-ab75-a4d346f27d22 => generated 1498 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:21:53.185431 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-cf62471b-af9d-4969-8e9b-32f45b46c579 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:21:53.186120 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-cf62471b-af9d-4969-8e9b-32f45b46c579 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: c9f6d441-246f-479e-8e88-ea701c0f87ff] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:53.204822 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-cf62471b-af9d-4969-8e9b-32f45b46c579 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:53.205449 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-cf62471b-af9d-4969-8e9b-32f45b46c579 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:53.206292 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-cf62471b-af9d-4969-8e9b-32f45b46c579 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:53.206698 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-cf62471b-af9d-4969-8e9b-32f45b46c579 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:53.208166 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-516916e9-e434-4ed1-81d9-91bd79c5116f tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:21:53.209420 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-516916e9-e434-4ed1-81d9-91bd79c5116f tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] [instance: 302ab8ef-5565-4f9b-9b91-b405d550a90d] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:53.216557 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-516916e9-e434-4ed1-81d9-91bd79c5116f tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:53.217175 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-516916e9-e434-4ed1-81d9-91bd79c5116f tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:53.218009 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-516916e9-e434-4ed1-81d9-91bd79c5116f tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:53.218445 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-516916e9-e434-4ed1-81d9-91bd79c5116f tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:53.249090 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.objects.instance [None req-516916e9-e434-4ed1-81d9-91bd79c5116f tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lazy-loading 'flavor' on Instance uuid 302ab8ef-5565-4f9b-9b91-b405d550a90d {{(pid=116272) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 22 12:21:53.360904 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-cf62471b-af9d-4969-8e9b-32f45b46c579 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:21:53.369675 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-cf62471b-af9d-4969-8e9b-32f45b46c579 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:21:53.371306 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-cf62471b-af9d-4969-8e9b-32f45b46c579 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:21:53.372668 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-cf62471b-af9d-4969-8e9b-32f45b46c579 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff" status: 200 len: 1724 microversion: 2.20 time: 0.194395 Nov 22 12:21:53.373220 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 272/552] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Nov 22 12:21:53 2021] GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff => generated 1724 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 12:21:53.400070 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-516916e9-e434-4ed1-81d9-91bd79c5116f tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] 10.222.0.66 "POST /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d/action" status: 200 len: 32 microversion: 2.1 time: 0.200821 Nov 22 12:21:53.400861 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 281/553] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Nov 22 12:21:53 2021] POST /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d/action => generated 32 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 22 12:21:53.409795 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-459d99b4-baa3-4ea7-b004-eca47b86162c tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:21:53.410389 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-459d99b4-baa3-4ea7-b004-eca47b86162c tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] [instance: 302ab8ef-5565-4f9b-9b91-b405d550a90d] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:53.417178 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-459d99b4-baa3-4ea7-b004-eca47b86162c tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:53.417726 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-459d99b4-baa3-4ea7-b004-eca47b86162c tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:53.419242 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-459d99b4-baa3-4ea7-b004-eca47b86162c tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:53.419665 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-459d99b4-baa3-4ea7-b004-eca47b86162c tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:53.454730 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-94ab947c-786c-4bb5-a2c2-30b5d0d08811 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:21:53.456417 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-94ab947c-786c-4bb5-a2c2-30b5d0d08811 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: 2306113c-8f98-42fd-8c0c-3dfac98fff21] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:53.464917 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-94ab947c-786c-4bb5-a2c2-30b5d0d08811 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:53.465423 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-94ab947c-786c-4bb5-a2c2-30b5d0d08811 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:53.466223 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-94ab947c-786c-4bb5-a2c2-30b5d0d08811 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:53.466735 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-94ab947c-786c-4bb5-a2c2-30b5d0d08811 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:53.574177 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-94ab947c-786c-4bb5-a2c2-30b5d0d08811 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "POST /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21/action" status: 200 len: 28184 microversion: 2.1 time: 0.123423 Nov 22 12:21:53.575906 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 282/554] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Nov 22 12:21:53 2021] POST /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21/action => generated 28184 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 22 12:21:53.578795 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-459d99b4-baa3-4ea7-b004-eca47b86162c tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1efac6c215148ce8c3ecdce1e9a8742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d392a7d77f46fcb4faa017786796fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:21:53.584224 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-4f3d3b04-bab4-460e-ab27-8bb2ca0b276d tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:21:53.586258 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-4f3d3b04-bab4-460e-ab27-8bb2ca0b276d tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] [instance: bcf45146-f982-459d-96c0-e7af402962e9] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:53.588716 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-459d99b4-baa3-4ea7-b004-eca47b86162c tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] 10.222.0.66 "GET /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d" status: 200 len: 1567 microversion: 2.1 time: 0.182467 Nov 22 12:21:53.590359 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 273/555] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:21:53 2021] GET /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d => generated 1567 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:21:53.599209 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-4f3d3b04-bab4-460e-ab27-8bb2ca0b276d tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:53.600383 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-4f3d3b04-bab4-460e-ab27-8bb2ca0b276d tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:53.601821 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-4f3d3b04-bab4-460e-ab27-8bb2ca0b276d tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:53.602601 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-4f3d3b04-bab4-460e-ab27-8bb2ca0b276d tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:53.791064 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-2d08b255-2236-4c6e-a980-770fffcd9984 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:21:53.791593 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-2d08b255-2236-4c6e-a980-770fffcd9984 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] [instance: 049121a2-b87d-4df0-ab75-a4d346f27d22] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:53.797823 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-2d08b255-2236-4c6e-a980-770fffcd9984 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:53.798242 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-2d08b255-2236-4c6e-a980-770fffcd9984 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:53.799017 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-2d08b255-2236-4c6e-a980-770fffcd9984 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:53.799818 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-2d08b255-2236-4c6e-a980-770fffcd9984 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:53.817250 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-4f3d3b04-bab4-460e-ab27-8bb2ca0b276d tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b581fa25045cea9585ae4e707585d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5319fd2dee9b4b47b98f59bca1572ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:21:53.825654 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-4f3d3b04-bab4-460e-ab27-8bb2ca0b276d tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] 10.222.0.66 "GET /compute/v2.1/servers/bcf45146-f982-459d-96c0-e7af402962e9" status: 200 len: 1318 microversion: 2.1 time: 0.247922 Nov 22 12:21:53.830985 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 283/556] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:21:53 2021] GET /compute/v2.1/servers/bcf45146-f982-459d-96c0-e7af402962e9 => generated 1318 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:21:53.844548 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-2d08b255-2236-4c6e-a980-770fffcd9984 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] [instance: 049121a2-b87d-4df0-ab75-a4d346f27d22] Going to try to terminate instance {{(pid=116273) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 22 12:21:53.931099 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-2d08b255-2236-4c6e-a980-770fffcd9984 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] 10.222.0.66 "DELETE /compute/v2.1/servers/049121a2-b87d-4df0-ab75-a4d346f27d22" status: 204 len: 0 microversion: 2.1 time: 0.143312 Nov 22 12:21:53.932084 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 274/557] 10.222.0.66 () {58 vars in 1238 bytes} [Mon Nov 22 12:21:53 2021] DELETE /compute/v2.1/servers/049121a2-b87d-4df0-ab75-a4d346f27d22 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 22 12:21:53.940835 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-377a2d76-48a9-4afc-bfdb-6ccd2ea6c9f8 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:21:53.941445 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-377a2d76-48a9-4afc-bfdb-6ccd2ea6c9f8 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] [instance: 049121a2-b87d-4df0-ab75-a4d346f27d22] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:53.947994 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-377a2d76-48a9-4afc-bfdb-6ccd2ea6c9f8 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:53.948499 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-377a2d76-48a9-4afc-bfdb-6ccd2ea6c9f8 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:53.949659 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-377a2d76-48a9-4afc-bfdb-6ccd2ea6c9f8 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:53.950099 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-377a2d76-48a9-4afc-bfdb-6ccd2ea6c9f8 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:54.092220 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-377a2d76-48a9-4afc-bfdb-6ccd2ea6c9f8 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8989f156c213442795edd8b9195bcbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad46aac0327b4760bef46d579031abd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:21:54.100474 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-377a2d76-48a9-4afc-bfdb-6ccd2ea6c9f8 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] 10.222.0.66 "GET /compute/v2.1/servers/049121a2-b87d-4df0-ab75-a4d346f27d22" status: 200 len: 1504 microversion: 2.1 time: 0.163362 Nov 22 12:21:54.101274 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 284/558] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:21:53 2021] GET /compute/v2.1/servers/049121a2-b87d-4df0-ab75-a4d346f27d22 => generated 1504 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:21:54.172286 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-a19cab68-a80a-4a77-8976-2f616cc4fec6 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:21:54.173105 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-a19cab68-a80a-4a77-8976-2f616cc4fec6 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] [instance: a3624677-f35c-4a8c-ad79-990ee6987c7b] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:54.180193 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-a19cab68-a80a-4a77-8976-2f616cc4fec6 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:54.180644 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-a19cab68-a80a-4a77-8976-2f616cc4fec6 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:54.181487 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-a19cab68-a80a-4a77-8976-2f616cc4fec6 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:54.181872 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-a19cab68-a80a-4a77-8976-2f616cc4fec6 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:54.265447 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.objects.instance [None req-a19cab68-a80a-4a77-8976-2f616cc4fec6 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lazy-loading 'services' on Instance uuid a3624677-f35c-4a8c-ad79-990ee6987c7b {{(pid=116273) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 22 12:21:54.340591 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-a19cab68-a80a-4a77-8976-2f616cc4fec6 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] 10.222.0.66 "DELETE /compute/v2.1/servers/a3624677-f35c-4a8c-ad79-990ee6987c7b/os-volume_attachments/dad3ebba-64a3-4336-af82-17fd065353db" status: 202 len: 0 microversion: 2.1 time: 0.172793 Nov 22 12:21:54.341306 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 275/559] 10.222.0.66 () {58 vars in 1415 bytes} [Mon Nov 22 12:21:54 2021] DELETE /compute/v2.1/servers/a3624677-f35c-4a8c-ad79-990ee6987c7b/os-volume_attachments/dad3ebba-64a3-4336-af82-17fd065353db => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 22 12:21:54.391960 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-f39dd2fd-f3ad-4752-af96-23aa29090f65 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:21:54.392502 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-f39dd2fd-f3ad-4752-af96-23aa29090f65 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: c9f6d441-246f-479e-8e88-ea701c0f87ff] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:54.402830 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-f39dd2fd-f3ad-4752-af96-23aa29090f65 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:54.403981 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-f39dd2fd-f3ad-4752-af96-23aa29090f65 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:54.404463 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-f39dd2fd-f3ad-4752-af96-23aa29090f65 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:54.405306 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-f39dd2fd-f3ad-4752-af96-23aa29090f65 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:54.547486 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-f39dd2fd-f3ad-4752-af96-23aa29090f65 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:21:54.555918 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-f39dd2fd-f3ad-4752-af96-23aa29090f65 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:21:54.557394 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-f39dd2fd-f3ad-4752-af96-23aa29090f65 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:21:54.559013 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-f39dd2fd-f3ad-4752-af96-23aa29090f65 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff" status: 200 len: 1724 microversion: 2.20 time: 0.170754 Nov 22 12:21:54.559786 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 285/560] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Nov 22 12:21:54 2021] GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 12:21:54.589315 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-085be626-a0dc-48ef-ac40-eeb8f1250f58 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:21:54.590946 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-085be626-a0dc-48ef-ac40-eeb8f1250f58 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: 2306113c-8f98-42fd-8c0c-3dfac98fff21] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:54.597541 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-085be626-a0dc-48ef-ac40-eeb8f1250f58 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:54.597989 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-085be626-a0dc-48ef-ac40-eeb8f1250f58 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:54.598776 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-085be626-a0dc-48ef-ac40-eeb8f1250f58 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:54.599205 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-085be626-a0dc-48ef-ac40-eeb8f1250f58 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:54.616135 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-10797e1c-0630-4d22-9fb4-3e577b30b765 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:21:54.616844 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-10797e1c-0630-4d22-9fb4-3e577b30b765 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] [instance: 302ab8ef-5565-4f9b-9b91-b405d550a90d] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:54.623253 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-10797e1c-0630-4d22-9fb4-3e577b30b765 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:54.623841 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-10797e1c-0630-4d22-9fb4-3e577b30b765 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:54.624746 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-10797e1c-0630-4d22-9fb4-3e577b30b765 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:54.625385 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-10797e1c-0630-4d22-9fb4-3e577b30b765 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:54.705532 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-085be626-a0dc-48ef-ac40-eeb8f1250f58 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "POST /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21/action" status: 200 len: 28184 microversion: 2.1 time: 0.120945 Nov 22 12:21:54.706459 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 276/561] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Nov 22 12:21:54 2021] POST /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21/action => generated 28184 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 12:21:54.772806 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-10797e1c-0630-4d22-9fb4-3e577b30b765 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1efac6c215148ce8c3ecdce1e9a8742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d392a7d77f46fcb4faa017786796fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:21:54.781025 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-10797e1c-0630-4d22-9fb4-3e577b30b765 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] 10.222.0.66 "GET /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d" status: 200 len: 1567 microversion: 2.1 time: 0.168761 Nov 22 12:21:54.781601 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 286/562] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:21:54 2021] GET /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d => generated 1567 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 12:21:54.848172 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-441ded3c-d92c-4646-bffe-171ea506defa tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:21:54.848873 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-441ded3c-d92c-4646-bffe-171ea506defa tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] [instance: bcf45146-f982-459d-96c0-e7af402962e9] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:54.856692 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-441ded3c-d92c-4646-bffe-171ea506defa tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:54.857128 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-441ded3c-d92c-4646-bffe-171ea506defa tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:54.857914 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-441ded3c-d92c-4646-bffe-171ea506defa tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:54.858352 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-441ded3c-d92c-4646-bffe-171ea506defa tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:55.013945 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-441ded3c-d92c-4646-bffe-171ea506defa tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b581fa25045cea9585ae4e707585d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5319fd2dee9b4b47b98f59bca1572ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:21:55.021358 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-441ded3c-d92c-4646-bffe-171ea506defa tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] 10.222.0.66 "GET /compute/v2.1/servers/bcf45146-f982-459d-96c0-e7af402962e9" status: 200 len: 1318 microversion: 2.1 time: 0.177322 Nov 22 12:21:55.021953 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 277/563] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:21:54 2021] GET /compute/v2.1/servers/bcf45146-f982-459d-96c0-e7af402962e9 => generated 1318 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:21:55.121452 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-50f0841e-5ced-4e6c-911b-a0bd509b1984 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:21:55.122120 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-50f0841e-5ced-4e6c-911b-a0bd509b1984 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] [instance: 049121a2-b87d-4df0-ab75-a4d346f27d22] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:55.128860 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-50f0841e-5ced-4e6c-911b-a0bd509b1984 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:55.129299 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-50f0841e-5ced-4e6c-911b-a0bd509b1984 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:55.130172 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-50f0841e-5ced-4e6c-911b-a0bd509b1984 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:55.130598 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-50f0841e-5ced-4e6c-911b-a0bd509b1984 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:55.283568 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-50f0841e-5ced-4e6c-911b-a0bd509b1984 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8989f156c213442795edd8b9195bcbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad46aac0327b4760bef46d579031abd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:21:55.291380 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-50f0841e-5ced-4e6c-911b-a0bd509b1984 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] 10.222.0.66 "GET /compute/v2.1/servers/049121a2-b87d-4df0-ab75-a4d346f27d22" status: 200 len: 1504 microversion: 2.1 time: 0.176447 Nov 22 12:21:55.291962 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 287/564] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:21:55 2021] GET /compute/v2.1/servers/049121a2-b87d-4df0-ab75-a4d346f27d22 => generated 1504 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:21:55.578836 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-e087062f-2212-4893-86b4-4e7f4bcd0f65 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:21:55.579634 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-e087062f-2212-4893-86b4-4e7f4bcd0f65 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: c9f6d441-246f-479e-8e88-ea701c0f87ff] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:55.586550 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-e087062f-2212-4893-86b4-4e7f4bcd0f65 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:55.587137 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-e087062f-2212-4893-86b4-4e7f4bcd0f65 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:55.588206 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-e087062f-2212-4893-86b4-4e7f4bcd0f65 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:55.588693 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-e087062f-2212-4893-86b4-4e7f4bcd0f65 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:55.718029 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-b0db84a6-55ef-491a-a448-760b0d1fe688 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:21:55.719891 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-b0db84a6-55ef-491a-a448-760b0d1fe688 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: 2306113c-8f98-42fd-8c0c-3dfac98fff21] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:55.725856 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-b0db84a6-55ef-491a-a448-760b0d1fe688 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:55.726304 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-b0db84a6-55ef-491a-a448-760b0d1fe688 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:55.727080 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-b0db84a6-55ef-491a-a448-760b0d1fe688 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:55.727732 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-b0db84a6-55ef-491a-a448-760b0d1fe688 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:55.783282 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-e087062f-2212-4893-86b4-4e7f4bcd0f65 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:21:55.793644 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-e087062f-2212-4893-86b4-4e7f4bcd0f65 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:21:55.795305 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-e087062f-2212-4893-86b4-4e7f4bcd0f65 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:21:55.796556 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-e087062f-2212-4893-86b4-4e7f4bcd0f65 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff" status: 200 len: 1724 microversion: 2.20 time: 0.222302 Nov 22 12:21:55.797206 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 278/565] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Nov 22 12:21:55 2021] GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff => generated 1724 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 12:21:55.801482 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-a2ca17e9-36a0-470c-885d-56a6d3b44f37 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:21:55.802071 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-a2ca17e9-36a0-470c-885d-56a6d3b44f37 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] [instance: 302ab8ef-5565-4f9b-9b91-b405d550a90d] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:55.808925 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-a2ca17e9-36a0-470c-885d-56a6d3b44f37 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:55.809452 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-a2ca17e9-36a0-470c-885d-56a6d3b44f37 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:55.810297 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-a2ca17e9-36a0-470c-885d-56a6d3b44f37 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:55.810795 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-a2ca17e9-36a0-470c-885d-56a6d3b44f37 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:55.820022 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-b0db84a6-55ef-491a-a448-760b0d1fe688 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "POST /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21/action" status: 200 len: 28184 microversion: 2.1 time: 0.106034 Nov 22 12:21:55.820720 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 288/566] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Nov 22 12:21:55 2021] POST /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21/action => generated 28184 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 12:21:55.952728 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-a2ca17e9-36a0-470c-885d-56a6d3b44f37 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1efac6c215148ce8c3ecdce1e9a8742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d392a7d77f46fcb4faa017786796fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:21:55.961062 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-a2ca17e9-36a0-470c-885d-56a6d3b44f37 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] 10.222.0.66 "GET /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d" status: 200 len: 1567 microversion: 2.1 time: 0.162886 Nov 22 12:21:55.961630 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 279/567] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:21:55 2021] GET /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d => generated 1567 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:21:56.038735 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-584b76c9-4b31-4e47-b4b4-c866af7e2b22 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:21:56.039692 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-584b76c9-4b31-4e47-b4b4-c866af7e2b22 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] [instance: bcf45146-f982-459d-96c0-e7af402962e9] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:56.054757 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-584b76c9-4b31-4e47-b4b4-c866af7e2b22 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:56.055297 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-584b76c9-4b31-4e47-b4b4-c866af7e2b22 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:56.056121 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-584b76c9-4b31-4e47-b4b4-c866af7e2b22 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:56.056563 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-584b76c9-4b31-4e47-b4b4-c866af7e2b22 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:56.194112 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-584b76c9-4b31-4e47-b4b4-c866af7e2b22 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b581fa25045cea9585ae4e707585d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5319fd2dee9b4b47b98f59bca1572ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:21:56.203589 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-584b76c9-4b31-4e47-b4b4-c866af7e2b22 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] 10.222.0.66 "GET /compute/v2.1/servers/bcf45146-f982-459d-96c0-e7af402962e9" status: 200 len: 1318 microversion: 2.1 time: 0.169188 Nov 22 12:21:56.204168 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 289/568] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:21:56 2021] GET /compute/v2.1/servers/bcf45146-f982-459d-96c0-e7af402962e9 => generated 1318 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 12:21:56.308622 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-8260fb5f-89fe-4651-aef9-a4df24f6f34b tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:21:56.309219 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-8260fb5f-89fe-4651-aef9-a4df24f6f34b tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] [instance: 049121a2-b87d-4df0-ab75-a4d346f27d22] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:56.315397 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-8260fb5f-89fe-4651-aef9-a4df24f6f34b tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:56.315930 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-8260fb5f-89fe-4651-aef9-a4df24f6f34b tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:56.316905 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-8260fb5f-89fe-4651-aef9-a4df24f6f34b tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:56.317404 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-8260fb5f-89fe-4651-aef9-a4df24f6f34b tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:56.467592 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-8260fb5f-89fe-4651-aef9-a4df24f6f34b tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8989f156c213442795edd8b9195bcbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad46aac0327b4760bef46d579031abd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:21:56.476347 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-8260fb5f-89fe-4651-aef9-a4df24f6f34b tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] 10.222.0.66 "GET /compute/v2.1/servers/049121a2-b87d-4df0-ab75-a4d346f27d22" status: 200 len: 1504 microversion: 2.1 time: 0.171425 Nov 22 12:21:56.476937 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 280/569] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:21:56 2021] GET /compute/v2.1/servers/049121a2-b87d-4df0-ab75-a4d346f27d22 => generated 1504 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:21:56.524871 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-d7c6e560-1e93-4c06-93d1-d16a99133927 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:21:56.525349 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-d7c6e560-1e93-4c06-93d1-d16a99133927 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] [instance: a3624677-f35c-4a8c-ad79-990ee6987c7b] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:56.531772 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-d7c6e560-1e93-4c06-93d1-d16a99133927 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:56.532260 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-d7c6e560-1e93-4c06-93d1-d16a99133927 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:56.533038 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-d7c6e560-1e93-4c06-93d1-d16a99133927 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:56.533464 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-d7c6e560-1e93-4c06-93d1-d16a99133927 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:56.559489 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-d7c6e560-1e93-4c06-93d1-d16a99133927 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] [instance: a3624677-f35c-4a8c-ad79-990ee6987c7b] Going to try to terminate instance {{(pid=116272) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 22 12:21:56.644317 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-d7c6e560-1e93-4c06-93d1-d16a99133927 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] 10.222.0.66 "DELETE /compute/v2.1/servers/a3624677-f35c-4a8c-ad79-990ee6987c7b" status: 204 len: 0 microversion: 2.1 time: 0.122777 Nov 22 12:21:56.644917 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 290/570] 10.222.0.66 () {58 vars in 1238 bytes} [Mon Nov 22 12:21:56 2021] DELETE /compute/v2.1/servers/a3624677-f35c-4a8c-ad79-990ee6987c7b => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 22 12:21:56.654477 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-8a142996-0a1b-4054-9199-192da0244c10 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:21:56.655388 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-8a142996-0a1b-4054-9199-192da0244c10 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] [instance: a3624677-f35c-4a8c-ad79-990ee6987c7b] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:56.671457 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-8a142996-0a1b-4054-9199-192da0244c10 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:56.672154 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-8a142996-0a1b-4054-9199-192da0244c10 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:56.673474 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-8a142996-0a1b-4054-9199-192da0244c10 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:56.674108 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-8a142996-0a1b-4054-9199-192da0244c10 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:56.823820 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-8a142996-0a1b-4054-9199-192da0244c10 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc29a63c701941f9909e8235c80f5ce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc74b1d74b14a009699279eb128f9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:21:56.825929 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-dc1040ae-2e4a-4d5c-81b8-9a794d763033 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:21:56.827172 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-dc1040ae-2e4a-4d5c-81b8-9a794d763033 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: c9f6d441-246f-479e-8e88-ea701c0f87ff] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:56.831760 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-8a142996-0a1b-4054-9199-192da0244c10 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] 10.222.0.66 "GET /compute/v2.1/servers/a3624677-f35c-4a8c-ad79-990ee6987c7b" status: 200 len: 1512 microversion: 2.1 time: 0.181882 Nov 22 12:21:56.841585 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 281/571] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:21:56 2021] GET /compute/v2.1/servers/a3624677-f35c-4a8c-ad79-990ee6987c7b => generated 1512 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:21:56.843579 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-dc1040ae-2e4a-4d5c-81b8-9a794d763033 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:56.844222 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-dc1040ae-2e4a-4d5c-81b8-9a794d763033 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:56.845242 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-dc1040ae-2e4a-4d5c-81b8-9a794d763033 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:56.845857 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-dc1040ae-2e4a-4d5c-81b8-9a794d763033 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:56.876162 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-3916c79c-f7c0-4233-9661-a9275ebd6d19 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:21:56.877934 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-3916c79c-f7c0-4233-9661-a9275ebd6d19 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: 2306113c-8f98-42fd-8c0c-3dfac98fff21] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:56.886411 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-3916c79c-f7c0-4233-9661-a9275ebd6d19 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:56.886917 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-3916c79c-f7c0-4233-9661-a9275ebd6d19 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:56.887964 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-3916c79c-f7c0-4233-9661-a9275ebd6d19 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:56.888562 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-3916c79c-f7c0-4233-9661-a9275ebd6d19 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:56.998538 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-3916c79c-f7c0-4233-9661-a9275ebd6d19 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "POST /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21/action" status: 200 len: 28309 microversion: 2.1 time: 0.164468 Nov 22 12:21:57.000237 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 282/572] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Nov 22 12:21:56 2021] POST /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21/action => generated 28309 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 12:21:57.006458 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-dc1040ae-2e4a-4d5c-81b8-9a794d763033 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:21:57.012167 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-5711b0d4-124d-4c5f-8a50-365207cf4140 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:21:57.012639 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-5711b0d4-124d-4c5f-8a50-365207cf4140 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] [instance: 302ab8ef-5565-4f9b-9b91-b405d550a90d] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:57.019931 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-dc1040ae-2e4a-4d5c-81b8-9a794d763033 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:21:57.020096 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-5711b0d4-124d-4c5f-8a50-365207cf4140 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:57.020537 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-5711b0d4-124d-4c5f-8a50-365207cf4140 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:57.021412 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-5711b0d4-124d-4c5f-8a50-365207cf4140 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:57.022000 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-5711b0d4-124d-4c5f-8a50-365207cf4140 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:57.022910 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-dc1040ae-2e4a-4d5c-81b8-9a794d763033 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:21:57.024802 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-dc1040ae-2e4a-4d5c-81b8-9a794d763033 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff" status: 200 len: 1724 microversion: 2.20 time: 0.212411 Nov 22 12:21:57.027624 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 291/573] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Nov 22 12:21:56 2021] GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff => generated 1724 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 12:21:57.191528 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [req-b67f5a8d-ec7e-4dcb-8f73-109de8b51d12 req-1ccdc049-0343-4473-8fda-a7960c6f4057 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "049121a2-b87d-4df0-ab75-a4d346f27d22", "name": "network-vif-deleted", "tag": "a4b96091-b3aa-436d-a620-de83c69919aa"}]} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:21:57.193165 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 12:21:57.193165 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: warnings.warn(msg) Nov 22 12:21:57.200987 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [req-b67f5a8d-ec7e-4dcb-8f73-109de8b51d12 req-1ccdc049-0343-4473-8fda-a7960c6f4057 service nova] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:57.201566 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [req-b67f5a8d-ec7e-4dcb-8f73-109de8b51d12 req-1ccdc049-0343-4473-8fda-a7960c6f4057 service nova] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:57.213688 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.compute.server_external_events [req-b67f5a8d-ec7e-4dcb-8f73-109de8b51d12 req-1ccdc049-0343-4473-8fda-a7960c6f4057 service nova] Creating event network-vif-deleted:a4b96091-b3aa-436d-a620-de83c69919aa for instance 049121a2-b87d-4df0-ab75-a4d346f27d22 on hv-cinder-76845 Nov 22 12:21:57.215328 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-5711b0d4-124d-4c5f-8a50-365207cf4140 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1efac6c215148ce8c3ecdce1e9a8742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d392a7d77f46fcb4faa017786796fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:21:57.220094 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [req-b67f5a8d-ec7e-4dcb-8f73-109de8b51d12 req-1ccdc049-0343-4473-8fda-a7960c6f4057 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032222 Nov 22 12:21:57.221411 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 292/574] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Nov 22 12:21:57 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 22 12:21:57.224226 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-5711b0d4-124d-4c5f-8a50-365207cf4140 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] 10.222.0.66 "GET /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d" status: 200 len: 1567 microversion: 2.1 time: 0.222610 Nov 22 12:21:57.225818 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 283/575] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:21:57 2021] GET /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d => generated 1567 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:21:57.228506 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-e2e06b39-c089-4550-bd26-e5180b9a2b89 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:21:57.229239 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-e2e06b39-c089-4550-bd26-e5180b9a2b89 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] [instance: bcf45146-f982-459d-96c0-e7af402962e9] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:57.236010 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-e2e06b39-c089-4550-bd26-e5180b9a2b89 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:57.236457 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-e2e06b39-c089-4550-bd26-e5180b9a2b89 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:57.237717 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-e2e06b39-c089-4550-bd26-e5180b9a2b89 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:57.238258 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-e2e06b39-c089-4550-bd26-e5180b9a2b89 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:57.392657 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-e2e06b39-c089-4550-bd26-e5180b9a2b89 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b581fa25045cea9585ae4e707585d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5319fd2dee9b4b47b98f59bca1572ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:21:57.400253 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-e2e06b39-c089-4550-bd26-e5180b9a2b89 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] 10.222.0.66 "GET /compute/v2.1/servers/bcf45146-f982-459d-96c0-e7af402962e9" status: 200 len: 1318 microversion: 2.1 time: 0.177535 Nov 22 12:21:57.400811 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 293/576] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:21:57 2021] GET /compute/v2.1/servers/bcf45146-f982-459d-96c0-e7af402962e9 => generated 1318 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:21:57.496313 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-6194ddda-b312-4fbc-b4c6-5cbe7fa9b60d tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:21:57.496947 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-6194ddda-b312-4fbc-b4c6-5cbe7fa9b60d tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] [instance: 049121a2-b87d-4df0-ab75-a4d346f27d22] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:57.504203 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-6194ddda-b312-4fbc-b4c6-5cbe7fa9b60d tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:57.504899 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-6194ddda-b312-4fbc-b4c6-5cbe7fa9b60d tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:57.505752 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-6194ddda-b312-4fbc-b4c6-5cbe7fa9b60d tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:57.506258 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-6194ddda-b312-4fbc-b4c6-5cbe7fa9b60d tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:57.541163 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-6194ddda-b312-4fbc-b4c6-5cbe7fa9b60d tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:57.541607 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-6194ddda-b312-4fbc-b4c6-5cbe7fa9b60d tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:57.542035 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.objects.instance [None req-6194ddda-b312-4fbc-b4c6-5cbe7fa9b60d tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Lazy-loading 'fault' on Instance uuid 049121a2-b87d-4df0-ab75-a4d346f27d22 {{(pid=116273) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 22 12:21:57.585878 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-6194ddda-b312-4fbc-b4c6-5cbe7fa9b60d tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8989f156c213442795edd8b9195bcbb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad46aac0327b4760bef46d579031abd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:21:57.593993 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-6194ddda-b312-4fbc-b4c6-5cbe7fa9b60d tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] 10.222.0.66 "GET /compute/v2.1/servers/049121a2-b87d-4df0-ab75-a4d346f27d22" status: 200 len: 1304 microversion: 2.1 time: 0.103337 Nov 22 12:21:57.594655 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 284/577] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:21:57 2021] GET /compute/v2.1/servers/049121a2-b87d-4df0-ab75-a4d346f27d22 => generated 1304 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:21:57.849787 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-7dc2371f-04a7-4fe7-a5b5-a1739fe81299 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:21:57.850382 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-7dc2371f-04a7-4fe7-a5b5-a1739fe81299 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] [instance: a3624677-f35c-4a8c-ad79-990ee6987c7b] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:57.857189 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-7dc2371f-04a7-4fe7-a5b5-a1739fe81299 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:57.857645 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-7dc2371f-04a7-4fe7-a5b5-a1739fe81299 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:57.858490 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-7dc2371f-04a7-4fe7-a5b5-a1739fe81299 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:57.858950 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-7dc2371f-04a7-4fe7-a5b5-a1739fe81299 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:58.009985 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-e9aee15d-2885-4600-bf64-892c1600ce59 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:21:58.011715 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-e9aee15d-2885-4600-bf64-892c1600ce59 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: 2306113c-8f98-42fd-8c0c-3dfac98fff21] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:58.020237 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-e9aee15d-2885-4600-bf64-892c1600ce59 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:58.020698 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-e9aee15d-2885-4600-bf64-892c1600ce59 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:58.021709 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-e9aee15d-2885-4600-bf64-892c1600ce59 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:58.022306 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-7dc2371f-04a7-4fe7-a5b5-a1739fe81299 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc29a63c701941f9909e8235c80f5ce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc74b1d74b14a009699279eb128f9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:21:58.022711 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-e9aee15d-2885-4600-bf64-892c1600ce59 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:58.030356 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-7dc2371f-04a7-4fe7-a5b5-a1739fe81299 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] 10.222.0.66 "GET /compute/v2.1/servers/a3624677-f35c-4a8c-ad79-990ee6987c7b" status: 200 len: 1512 microversion: 2.1 time: 0.184503 Nov 22 12:21:58.030899 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 294/578] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:21:57 2021] GET /compute/v2.1/servers/a3624677-f35c-4a8c-ad79-990ee6987c7b => generated 1512 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:21:58.043814 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-40283dbc-c4c9-4846-ac12-59f8328e4272 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:21:58.044347 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-40283dbc-c4c9-4846-ac12-59f8328e4272 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: c9f6d441-246f-479e-8e88-ea701c0f87ff] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:58.050352 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-40283dbc-c4c9-4846-ac12-59f8328e4272 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:58.050795 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-40283dbc-c4c9-4846-ac12-59f8328e4272 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:58.051608 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-40283dbc-c4c9-4846-ac12-59f8328e4272 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:58.052034 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-40283dbc-c4c9-4846-ac12-59f8328e4272 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:58.121686 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-e9aee15d-2885-4600-bf64-892c1600ce59 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "POST /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21/action" status: 200 len: 28474 microversion: 2.1 time: 0.115021 Nov 22 12:21:58.126433 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 285/579] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Nov 22 12:21:58 2021] POST /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21/action => generated 28474 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 22 12:21:58.194309 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-40283dbc-c4c9-4846-ac12-59f8328e4272 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:21:58.202554 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-40283dbc-c4c9-4846-ac12-59f8328e4272 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:21:58.204115 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-40283dbc-c4c9-4846-ac12-59f8328e4272 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:21:58.205311 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-40283dbc-c4c9-4846-ac12-59f8328e4272 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff" status: 200 len: 1724 microversion: 2.20 time: 0.165045 Nov 22 12:21:58.205892 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 295/580] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Nov 22 12:21:58 2021] GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 12:21:58.243089 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-63bac702-4265-4a3e-a694-bca6af2145ee tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:21:58.244165 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-63bac702-4265-4a3e-a694-bca6af2145ee tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] [instance: 302ab8ef-5565-4f9b-9b91-b405d550a90d] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:58.252272 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-63bac702-4265-4a3e-a694-bca6af2145ee tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:58.252892 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-63bac702-4265-4a3e-a694-bca6af2145ee tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:58.253984 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-63bac702-4265-4a3e-a694-bca6af2145ee tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:58.254444 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-63bac702-4265-4a3e-a694-bca6af2145ee tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:58.418219 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-0ddc555e-20cc-45d7-a691-f133e08369fe tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:21:58.418831 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-0ddc555e-20cc-45d7-a691-f133e08369fe tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] [instance: bcf45146-f982-459d-96c0-e7af402962e9] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:58.425711 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-0ddc555e-20cc-45d7-a691-f133e08369fe tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:58.426119 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-0ddc555e-20cc-45d7-a691-f133e08369fe tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:58.426911 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-0ddc555e-20cc-45d7-a691-f133e08369fe tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:58.427375 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-0ddc555e-20cc-45d7-a691-f133e08369fe tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:58.435969 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-63bac702-4265-4a3e-a694-bca6af2145ee tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1efac6c215148ce8c3ecdce1e9a8742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d392a7d77f46fcb4faa017786796fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:21:58.444201 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-63bac702-4265-4a3e-a694-bca6af2145ee tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] 10.222.0.66 "GET /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d" status: 200 len: 1567 microversion: 2.1 time: 0.205888 Nov 22 12:21:58.444868 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 286/581] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:21:58 2021] GET /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d => generated 1567 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:21:58.565023 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-0ddc555e-20cc-45d7-a691-f133e08369fe tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b581fa25045cea9585ae4e707585d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5319fd2dee9b4b47b98f59bca1572ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:21:58.572713 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-0ddc555e-20cc-45d7-a691-f133e08369fe tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] 10.222.0.66 "GET /compute/v2.1/servers/bcf45146-f982-459d-96c0-e7af402962e9" status: 200 len: 1318 microversion: 2.1 time: 0.158145 Nov 22 12:21:58.573861 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 296/582] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:21:58 2021] GET /compute/v2.1/servers/bcf45146-f982-459d-96c0-e7af402962e9 => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:21:58.613568 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-1b6693cf-ad15-4bd0-90b3-f3dc63951ff5 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:21:58.614342 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-1b6693cf-ad15-4bd0-90b3-f3dc63951ff5 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] [instance: 049121a2-b87d-4df0-ab75-a4d346f27d22] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:58.621126 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-1b6693cf-ad15-4bd0-90b3-f3dc63951ff5 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:58.621571 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-1b6693cf-ad15-4bd0-90b3-f3dc63951ff5 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:58.622347 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-1b6693cf-ad15-4bd0-90b3-f3dc63951ff5 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:58.622771 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-1b6693cf-ad15-4bd0-90b3-f3dc63951ff5 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:58.639565 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.wsgi [None req-1b6693cf-ad15-4bd0-90b3-f3dc63951ff5 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] HTTP exception thrown: Instance 049121a2-b87d-4df0-ab75-a4d346f27d22 could not be found. Nov 22 12:21:58.640061 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-1b6693cf-ad15-4bd0-90b3-f3dc63951ff5 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] Returning 404 to user: Instance 049121a2-b87d-4df0-ab75-a4d346f27d22 could not be found. {{(pid=116273) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 12:21:58.640883 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-1b6693cf-ad15-4bd0-90b3-f3dc63951ff5 tempest-VolumesActionsTest-302249309 tempest-VolumesActionsTest-302249309-project] 10.222.0.66 "GET /compute/v2.1/servers/049121a2-b87d-4df0-ab75-a4d346f27d22" status: 404 len: 111 microversion: 2.1 time: 0.031191 Nov 22 12:21:58.641430 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 287/583] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:21:58 2021] GET /compute/v2.1/servers/049121a2-b87d-4df0-ab75-a4d346f27d22 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 22 12:21:58.725477 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [req-a9f547b6-9620-43c0-a785-944a70b56e1c req-f32a9fc4-cbda-4f9b-ab9d-322935d59bce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bcf45146-f982-459d-96c0-e7af402962e9", "name": "network-vif-plugged", "status": "completed", "tag": "34ab8e79-23fc-4427-bf02-045bf7c07481"}]} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:21:58.731046 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 12:21:58.731046 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: warnings.warn(msg) Nov 22 12:21:58.740050 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [req-a9f547b6-9620-43c0-a785-944a70b56e1c req-f32a9fc4-cbda-4f9b-ab9d-322935d59bce service nova] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:58.740902 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [req-a9f547b6-9620-43c0-a785-944a70b56e1c req-f32a9fc4-cbda-4f9b-ab9d-322935d59bce service nova] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:58.752817 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.compute.server_external_events [req-a9f547b6-9620-43c0-a785-944a70b56e1c req-f32a9fc4-cbda-4f9b-ab9d-322935d59bce service nova] Creating event network-vif-plugged:34ab8e79-23fc-4427-bf02-045bf7c07481 for instance bcf45146-f982-459d-96c0-e7af402962e9 on hv-cinder-76845 Nov 22 12:21:58.758459 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [req-a9f547b6-9620-43c0-a785-944a70b56e1c req-f32a9fc4-cbda-4f9b-ab9d-322935d59bce service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037962 Nov 22 12:21:58.759169 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 297/584] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Nov 22 12:21:58 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 12:21:59.048899 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-ddcf028c-30b5-42b4-b081-a3dacb51fea9 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:21:59.049491 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-ddcf028c-30b5-42b4-b081-a3dacb51fea9 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] [instance: a3624677-f35c-4a8c-ad79-990ee6987c7b] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:59.056366 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-ddcf028c-30b5-42b4-b081-a3dacb51fea9 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:59.056829 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-ddcf028c-30b5-42b4-b081-a3dacb51fea9 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:59.057651 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-ddcf028c-30b5-42b4-b081-a3dacb51fea9 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:59.058079 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-ddcf028c-30b5-42b4-b081-a3dacb51fea9 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:59.143053 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-8873dae9-50ed-49b2-a92c-e4ef0be7140c tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:21:59.143053 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-8873dae9-50ed-49b2-a92c-e4ef0be7140c tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: 2306113c-8f98-42fd-8c0c-3dfac98fff21] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:59.143537 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-8873dae9-50ed-49b2-a92c-e4ef0be7140c tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:59.143951 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-8873dae9-50ed-49b2-a92c-e4ef0be7140c tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:59.144841 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-8873dae9-50ed-49b2-a92c-e4ef0be7140c tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:59.145295 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-8873dae9-50ed-49b2-a92c-e4ef0be7140c tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:59.199115 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-ddcf028c-30b5-42b4-b081-a3dacb51fea9 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc29a63c701941f9909e8235c80f5ce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc74b1d74b14a009699279eb128f9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:21:59.206923 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-ddcf028c-30b5-42b4-b081-a3dacb51fea9 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] 10.222.0.66 "GET /compute/v2.1/servers/a3624677-f35c-4a8c-ad79-990ee6987c7b" status: 200 len: 1512 microversion: 2.1 time: 0.162432 Nov 22 12:21:59.207506 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 288/585] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:21:59 2021] GET /compute/v2.1/servers/a3624677-f35c-4a8c-ad79-990ee6987c7b => generated 1512 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:21:59.223541 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-c1591e86-18a4-4efb-875e-f49a0d588072 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:21:59.224133 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-c1591e86-18a4-4efb-875e-f49a0d588072 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: c9f6d441-246f-479e-8e88-ea701c0f87ff] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:59.229928 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-c1591e86-18a4-4efb-875e-f49a0d588072 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:59.230378 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-c1591e86-18a4-4efb-875e-f49a0d588072 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:59.231194 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-c1591e86-18a4-4efb-875e-f49a0d588072 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:59.231643 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-c1591e86-18a4-4efb-875e-f49a0d588072 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:59.379729 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-c1591e86-18a4-4efb-875e-f49a0d588072 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:21:59.388626 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-c1591e86-18a4-4efb-875e-f49a0d588072 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:21:59.390529 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-c1591e86-18a4-4efb-875e-f49a0d588072 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:21:59.392110 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-c1591e86-18a4-4efb-875e-f49a0d588072 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff" status: 200 len: 1724 microversion: 2.20 time: 0.172032 Nov 22 12:21:59.392731 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 289/586] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Nov 22 12:21:59 2021] GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff => generated 1724 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 22 12:21:59.461573 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-bd4549f8-b834-4a3a-91dd-009ff81a0622 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:21:59.462181 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-bd4549f8-b834-4a3a-91dd-009ff81a0622 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] [instance: 302ab8ef-5565-4f9b-9b91-b405d550a90d] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:59.469388 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-bd4549f8-b834-4a3a-91dd-009ff81a0622 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:59.469833 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-bd4549f8-b834-4a3a-91dd-009ff81a0622 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:59.470841 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-bd4549f8-b834-4a3a-91dd-009ff81a0622 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:59.471350 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-bd4549f8-b834-4a3a-91dd-009ff81a0622 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:59.609600 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-bd4549f8-b834-4a3a-91dd-009ff81a0622 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1efac6c215148ce8c3ecdce1e9a8742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d392a7d77f46fcb4faa017786796fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:21:59.621195 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-bd4549f8-b834-4a3a-91dd-009ff81a0622 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] 10.222.0.66 "GET /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d" status: 200 len: 1567 microversion: 2.1 time: 0.163059 Nov 22 12:21:59.622113 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 290/587] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:21:59 2021] GET /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d => generated 1567 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:21:59.626632 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-2a7808fc-84f4-4771-b63a-8055a2c9bf84 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:21:59.627257 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-2a7808fc-84f4-4771-b63a-8055a2c9bf84 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] [instance: bcf45146-f982-459d-96c0-e7af402962e9] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:21:59.634081 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-2a7808fc-84f4-4771-b63a-8055a2c9bf84 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:59.634790 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-2a7808fc-84f4-4771-b63a-8055a2c9bf84 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:59.635881 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-2a7808fc-84f4-4771-b63a-8055a2c9bf84 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:21:59.636523 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-2a7808fc-84f4-4771-b63a-8055a2c9bf84 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:21:59.796076 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-2a7808fc-84f4-4771-b63a-8055a2c9bf84 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b581fa25045cea9585ae4e707585d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5319fd2dee9b4b47b98f59bca1572ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:21:59.804203 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-2a7808fc-84f4-4771-b63a-8055a2c9bf84 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] 10.222.0.66 "GET /compute/v2.1/servers/bcf45146-f982-459d-96c0-e7af402962e9" status: 200 len: 1318 microversion: 2.1 time: 0.181154 Nov 22 12:21:59.804770 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 291/588] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:21:59 2021] GET /compute/v2.1/servers/bcf45146-f982-459d-96c0-e7af402962e9 => generated 1318 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:22:00.225640 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-84783a7f-78d6-4f82-96a9-2f0a92201869 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:22:00.226289 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-84783a7f-78d6-4f82-96a9-2f0a92201869 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] [instance: a3624677-f35c-4a8c-ad79-990ee6987c7b] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:00.232833 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-84783a7f-78d6-4f82-96a9-2f0a92201869 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:00.233286 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-84783a7f-78d6-4f82-96a9-2f0a92201869 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:00.234061 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-84783a7f-78d6-4f82-96a9-2f0a92201869 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:00.234499 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-84783a7f-78d6-4f82-96a9-2f0a92201869 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:00.381248 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-84783a7f-78d6-4f82-96a9-2f0a92201869 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc29a63c701941f9909e8235c80f5ce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc74b1d74b14a009699279eb128f9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:00.389664 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-84783a7f-78d6-4f82-96a9-2f0a92201869 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] 10.222.0.66 "GET /compute/v2.1/servers/a3624677-f35c-4a8c-ad79-990ee6987c7b" status: 200 len: 1512 microversion: 2.1 time: 0.167826 Nov 22 12:22:00.390318 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 292/589] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:22:00 2021] GET /compute/v2.1/servers/a3624677-f35c-4a8c-ad79-990ee6987c7b => generated 1512 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:22:00.411515 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-d9a388f8-a648-4110-9d34-2472827e4594 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:22:00.412118 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-d9a388f8-a648-4110-9d34-2472827e4594 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: c9f6d441-246f-479e-8e88-ea701c0f87ff] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:00.418733 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-d9a388f8-a648-4110-9d34-2472827e4594 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:00.419177 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-d9a388f8-a648-4110-9d34-2472827e4594 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:00.419987 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-d9a388f8-a648-4110-9d34-2472827e4594 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:00.420418 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-d9a388f8-a648-4110-9d34-2472827e4594 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:00.567658 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-d9a388f8-a648-4110-9d34-2472827e4594 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:00.579720 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-d9a388f8-a648-4110-9d34-2472827e4594 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:00.581210 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-d9a388f8-a648-4110-9d34-2472827e4594 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:00.582369 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-d9a388f8-a648-4110-9d34-2472827e4594 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff" status: 200 len: 1724 microversion: 2.20 time: 0.175925 Nov 22 12:22:00.582930 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 293/590] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Nov 22 12:22:00 2021] GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff => generated 1724 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 12:22:00.637967 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-4b9381b6-8517-4be7-87e9-b0b9f02bc98b tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:22:00.638568 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-4b9381b6-8517-4be7-87e9-b0b9f02bc98b tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] [instance: 302ab8ef-5565-4f9b-9b91-b405d550a90d] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:00.645416 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-4b9381b6-8517-4be7-87e9-b0b9f02bc98b tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:00.645867 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-4b9381b6-8517-4be7-87e9-b0b9f02bc98b tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:00.646656 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-4b9381b6-8517-4be7-87e9-b0b9f02bc98b tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:00.647090 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-4b9381b6-8517-4be7-87e9-b0b9f02bc98b tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:00.802120 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-4b9381b6-8517-4be7-87e9-b0b9f02bc98b tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1efac6c215148ce8c3ecdce1e9a8742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d392a7d77f46fcb4faa017786796fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:00.813496 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-4b9381b6-8517-4be7-87e9-b0b9f02bc98b tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] 10.222.0.66 "GET /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d" status: 200 len: 1567 microversion: 2.1 time: 0.178395 Nov 22 12:22:00.814092 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 294/591] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:22:00 2021] GET /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d => generated 1567 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:22:00.821984 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-35e14261-d7c0-4d58-aa51-785d38d2e75e tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:22:00.822727 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-35e14261-d7c0-4d58-aa51-785d38d2e75e tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] [instance: bcf45146-f982-459d-96c0-e7af402962e9] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:00.828756 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-35e14261-d7c0-4d58-aa51-785d38d2e75e tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:00.829321 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-35e14261-d7c0-4d58-aa51-785d38d2e75e tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:00.829980 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-35e14261-d7c0-4d58-aa51-785d38d2e75e tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:00.830410 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-35e14261-d7c0-4d58-aa51-785d38d2e75e tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:00.977798 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-35e14261-d7c0-4d58-aa51-785d38d2e75e tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b581fa25045cea9585ae4e707585d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5319fd2dee9b4b47b98f59bca1572ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:00.985700 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-35e14261-d7c0-4d58-aa51-785d38d2e75e tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] 10.222.0.66 "GET /compute/v2.1/servers/bcf45146-f982-459d-96c0-e7af402962e9" status: 200 len: 1318 microversion: 2.1 time: 0.167798 Nov 22 12:22:00.986275 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 295/592] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:22:00 2021] GET /compute/v2.1/servers/bcf45146-f982-459d-96c0-e7af402962e9 => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:22:01.407769 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-32e36fb2-6eee-4a4e-b6f7-9ed5510bc3d5 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:22:01.408443 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-32e36fb2-6eee-4a4e-b6f7-9ed5510bc3d5 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] [instance: a3624677-f35c-4a8c-ad79-990ee6987c7b] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:01.415183 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-32e36fb2-6eee-4a4e-b6f7-9ed5510bc3d5 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:01.415653 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-32e36fb2-6eee-4a4e-b6f7-9ed5510bc3d5 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:01.416433 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-32e36fb2-6eee-4a4e-b6f7-9ed5510bc3d5 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:01.416857 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-32e36fb2-6eee-4a4e-b6f7-9ed5510bc3d5 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:01.564570 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-32e36fb2-6eee-4a4e-b6f7-9ed5510bc3d5 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc29a63c701941f9909e8235c80f5ce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc74b1d74b14a009699279eb128f9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:01.572295 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-32e36fb2-6eee-4a4e-b6f7-9ed5510bc3d5 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] 10.222.0.66 "GET /compute/v2.1/servers/a3624677-f35c-4a8c-ad79-990ee6987c7b" status: 200 len: 1512 microversion: 2.1 time: 0.169036 Nov 22 12:22:01.572851 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 296/593] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:22:01 2021] GET /compute/v2.1/servers/a3624677-f35c-4a8c-ad79-990ee6987c7b => generated 1512 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:22:01.601775 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-550bbd42-f506-45cb-9241-757b5b0e6fe9 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:22:01.602359 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-550bbd42-f506-45cb-9241-757b5b0e6fe9 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: c9f6d441-246f-479e-8e88-ea701c0f87ff] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:01.609081 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-550bbd42-f506-45cb-9241-757b5b0e6fe9 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:01.609536 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-550bbd42-f506-45cb-9241-757b5b0e6fe9 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:01.610295 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-550bbd42-f506-45cb-9241-757b5b0e6fe9 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:01.610722 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-550bbd42-f506-45cb-9241-757b5b0e6fe9 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:01.747691 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-550bbd42-f506-45cb-9241-757b5b0e6fe9 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:01.756752 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-550bbd42-f506-45cb-9241-757b5b0e6fe9 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:01.758188 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-550bbd42-f506-45cb-9241-757b5b0e6fe9 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:01.759423 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-550bbd42-f506-45cb-9241-757b5b0e6fe9 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff" status: 200 len: 1724 microversion: 2.20 time: 0.161513 Nov 22 12:22:01.760214 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 297/594] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Nov 22 12:22:01 2021] GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 22 12:22:01.794249 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-8873dae9-50ed-49b2-a92c-e4ef0be7140c tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "POST /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21/action" status: 200 len: 28474 microversion: 2.1 time: 2.663385 Nov 22 12:22:01.795397 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 298/595] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Nov 22 12:21:59 2021] POST /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21/action => generated 28474 bytes in 2666 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 12:22:01.830718 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-5a8ae9b9-9f73-4efb-95dd-26eaf554a852 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:22:01.831355 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-5a8ae9b9-9f73-4efb-95dd-26eaf554a852 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] [instance: 302ab8ef-5565-4f9b-9b91-b405d550a90d] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:01.837493 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-5a8ae9b9-9f73-4efb-95dd-26eaf554a852 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:01.837935 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-5a8ae9b9-9f73-4efb-95dd-26eaf554a852 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:01.838789 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-5a8ae9b9-9f73-4efb-95dd-26eaf554a852 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:01.839207 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-5a8ae9b9-9f73-4efb-95dd-26eaf554a852 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:01.977015 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-5a8ae9b9-9f73-4efb-95dd-26eaf554a852 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1efac6c215148ce8c3ecdce1e9a8742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d392a7d77f46fcb4faa017786796fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:01.985373 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-5a8ae9b9-9f73-4efb-95dd-26eaf554a852 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] 10.222.0.66 "GET /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d" status: 200 len: 1567 microversion: 2.1 time: 0.158450 Nov 22 12:22:01.985946 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 298/596] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:22:01 2021] GET /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:22:02.010371 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-da8a9708-b98c-43b6-af87-4c11df340832 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:22:02.011597 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-da8a9708-b98c-43b6-af87-4c11df340832 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] [instance: bcf45146-f982-459d-96c0-e7af402962e9] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:02.020484 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-da8a9708-b98c-43b6-af87-4c11df340832 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:02.020994 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-da8a9708-b98c-43b6-af87-4c11df340832 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:02.021775 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-da8a9708-b98c-43b6-af87-4c11df340832 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:02.022205 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-da8a9708-b98c-43b6-af87-4c11df340832 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:02.162513 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-da8a9708-b98c-43b6-af87-4c11df340832 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b581fa25045cea9585ae4e707585d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5319fd2dee9b4b47b98f59bca1572ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:02.173206 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-da8a9708-b98c-43b6-af87-4c11df340832 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] 10.222.0.66 "GET /compute/v2.1/servers/bcf45146-f982-459d-96c0-e7af402962e9" status: 200 len: 1318 microversion: 2.1 time: 0.168684 Nov 22 12:22:02.173803 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 299/597] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:22:02 2021] GET /compute/v2.1/servers/bcf45146-f982-459d-96c0-e7af402962e9 => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:22:02.589670 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-fee64490-e0bf-4e87-a239-4c75f9c8810f tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:22:02.590288 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-fee64490-e0bf-4e87-a239-4c75f9c8810f tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] [instance: a3624677-f35c-4a8c-ad79-990ee6987c7b] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:02.597052 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-fee64490-e0bf-4e87-a239-4c75f9c8810f tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:02.597498 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-fee64490-e0bf-4e87-a239-4c75f9c8810f tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:02.598285 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-fee64490-e0bf-4e87-a239-4c75f9c8810f tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:02.598714 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-fee64490-e0bf-4e87-a239-4c75f9c8810f tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:02.732865 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-fee64490-e0bf-4e87-a239-4c75f9c8810f tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc29a63c701941f9909e8235c80f5ce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc74b1d74b14a009699279eb128f9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:02.741236 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-fee64490-e0bf-4e87-a239-4c75f9c8810f tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] 10.222.0.66 "GET /compute/v2.1/servers/a3624677-f35c-4a8c-ad79-990ee6987c7b" status: 200 len: 1512 microversion: 2.1 time: 0.155532 Nov 22 12:22:02.741807 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 299/598] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:22:02 2021] GET /compute/v2.1/servers/a3624677-f35c-4a8c-ad79-990ee6987c7b => generated 1512 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:22:02.781926 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-ad3ce17c-ba1d-4101-86ca-12c2937bb9eb tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:22:02.782589 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-ad3ce17c-ba1d-4101-86ca-12c2937bb9eb tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: c9f6d441-246f-479e-8e88-ea701c0f87ff] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:02.792605 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-ad3ce17c-ba1d-4101-86ca-12c2937bb9eb tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:02.793243 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-ad3ce17c-ba1d-4101-86ca-12c2937bb9eb tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:02.794400 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-ad3ce17c-ba1d-4101-86ca-12c2937bb9eb tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:02.795353 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-ad3ce17c-ba1d-4101-86ca-12c2937bb9eb tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:02.806059 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-5b6c6dc6-7f66-4ec3-9715-52e95a0aee82 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:22:02.807049 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-5b6c6dc6-7f66-4ec3-9715-52e95a0aee82 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: 2306113c-8f98-42fd-8c0c-3dfac98fff21] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:02.813576 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-5b6c6dc6-7f66-4ec3-9715-52e95a0aee82 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:02.814033 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-5b6c6dc6-7f66-4ec3-9715-52e95a0aee82 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:02.814819 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-5b6c6dc6-7f66-4ec3-9715-52e95a0aee82 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:02.815268 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-5b6c6dc6-7f66-4ec3-9715-52e95a0aee82 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:02.935799 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-ad3ce17c-ba1d-4101-86ca-12c2937bb9eb tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:02.944894 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-ad3ce17c-ba1d-4101-86ca-12c2937bb9eb tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:02.946394 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-ad3ce17c-ba1d-4101-86ca-12c2937bb9eb tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:02.947589 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-ad3ce17c-ba1d-4101-86ca-12c2937bb9eb tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff" status: 200 len: 1724 microversion: 2.20 time: 0.171765 Nov 22 12:22:02.948154 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 300/599] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Nov 22 12:22:02 2021] GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff => generated 1724 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 12:22:03.002833 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-767ff68f-00bf-4aba-8c58-3ccee39caea9 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:22:03.003493 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-767ff68f-00bf-4aba-8c58-3ccee39caea9 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] [instance: 302ab8ef-5565-4f9b-9b91-b405d550a90d] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:03.010224 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-767ff68f-00bf-4aba-8c58-3ccee39caea9 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:03.010662 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-767ff68f-00bf-4aba-8c58-3ccee39caea9 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:03.011487 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-767ff68f-00bf-4aba-8c58-3ccee39caea9 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:03.011918 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-767ff68f-00bf-4aba-8c58-3ccee39caea9 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:03.150967 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-767ff68f-00bf-4aba-8c58-3ccee39caea9 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1efac6c215148ce8c3ecdce1e9a8742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d392a7d77f46fcb4faa017786796fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:03.161186 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-767ff68f-00bf-4aba-8c58-3ccee39caea9 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] 10.222.0.66 "GET /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d" status: 200 len: 1567 microversion: 2.1 time: 0.162494 Nov 22 12:22:03.161756 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 301/600] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:22:02 2021] GET /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d => generated 1567 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:22:03.193131 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-5af8da15-dcaf-4d6d-9165-bb6e9f16bd30 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:22:03.193724 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-5af8da15-dcaf-4d6d-9165-bb6e9f16bd30 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] [instance: bcf45146-f982-459d-96c0-e7af402962e9] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:03.200136 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-5af8da15-dcaf-4d6d-9165-bb6e9f16bd30 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:03.200590 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-5af8da15-dcaf-4d6d-9165-bb6e9f16bd30 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:03.201343 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-5af8da15-dcaf-4d6d-9165-bb6e9f16bd30 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:03.201771 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-5af8da15-dcaf-4d6d-9165-bb6e9f16bd30 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:03.358800 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-5af8da15-dcaf-4d6d-9165-bb6e9f16bd30 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b581fa25045cea9585ae4e707585d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5319fd2dee9b4b47b98f59bca1572ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:03.367153 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-5af8da15-dcaf-4d6d-9165-bb6e9f16bd30 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] 10.222.0.66 "GET /compute/v2.1/servers/bcf45146-f982-459d-96c0-e7af402962e9" status: 200 len: 1318 microversion: 2.1 time: 0.177424 Nov 22 12:22:03.367732 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 302/601] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:22:03 2021] GET /compute/v2.1/servers/bcf45146-f982-459d-96c0-e7af402962e9 => generated 1318 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 12:22:03.761494 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-ca49c5e2-429f-4b82-be26-aae07803cbe0 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:22:03.762098 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-ca49c5e2-429f-4b82-be26-aae07803cbe0 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] [instance: a3624677-f35c-4a8c-ad79-990ee6987c7b] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:03.769381 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-ca49c5e2-429f-4b82-be26-aae07803cbe0 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:03.769836 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-ca49c5e2-429f-4b82-be26-aae07803cbe0 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:03.770606 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-ca49c5e2-429f-4b82-be26-aae07803cbe0 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:03.771021 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-ca49c5e2-429f-4b82-be26-aae07803cbe0 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:03.915284 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-ca49c5e2-429f-4b82-be26-aae07803cbe0 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc29a63c701941f9909e8235c80f5ce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc74b1d74b14a009699279eb128f9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:03.925878 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-ca49c5e2-429f-4b82-be26-aae07803cbe0 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] 10.222.0.66 "GET /compute/v2.1/servers/a3624677-f35c-4a8c-ad79-990ee6987c7b" status: 200 len: 1512 microversion: 2.1 time: 0.168042 Nov 22 12:22:03.926505 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 303/602] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:22:03 2021] GET /compute/v2.1/servers/a3624677-f35c-4a8c-ad79-990ee6987c7b => generated 1512 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:22:03.969489 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-a9e86acc-5fe6-4e92-86e4-eb3ea749fba3 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:22:03.970113 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-a9e86acc-5fe6-4e92-86e4-eb3ea749fba3 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: c9f6d441-246f-479e-8e88-ea701c0f87ff] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:03.977073 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-a9e86acc-5fe6-4e92-86e4-eb3ea749fba3 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:03.977686 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-a9e86acc-5fe6-4e92-86e4-eb3ea749fba3 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:03.978550 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-a9e86acc-5fe6-4e92-86e4-eb3ea749fba3 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:03.978979 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-a9e86acc-5fe6-4e92-86e4-eb3ea749fba3 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:04.129327 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-a9e86acc-5fe6-4e92-86e4-eb3ea749fba3 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:04.137971 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-a9e86acc-5fe6-4e92-86e4-eb3ea749fba3 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:04.139474 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-a9e86acc-5fe6-4e92-86e4-eb3ea749fba3 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:04.140752 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-a9e86acc-5fe6-4e92-86e4-eb3ea749fba3 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff" status: 200 len: 1724 microversion: 2.20 time: 0.176393 Nov 22 12:22:04.141319 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 304/603] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Nov 22 12:22:03 2021] GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff => generated 1724 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 12:22:04.181767 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-1c57bee0-ef68-4e9a-9697-8531f5094e13 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:22:04.182749 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-1c57bee0-ef68-4e9a-9697-8531f5094e13 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] [instance: 302ab8ef-5565-4f9b-9b91-b405d550a90d] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:04.191959 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-1c57bee0-ef68-4e9a-9697-8531f5094e13 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:04.192533 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-1c57bee0-ef68-4e9a-9697-8531f5094e13 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:04.193663 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-1c57bee0-ef68-4e9a-9697-8531f5094e13 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:04.194313 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-1c57bee0-ef68-4e9a-9697-8531f5094e13 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:04.342062 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-1c57bee0-ef68-4e9a-9697-8531f5094e13 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1efac6c215148ce8c3ecdce1e9a8742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d392a7d77f46fcb4faa017786796fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:04.353482 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-1c57bee0-ef68-4e9a-9697-8531f5094e13 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] 10.222.0.66 "GET /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d" status: 200 len: 1567 microversion: 2.1 time: 0.177309 Nov 22 12:22:04.354305 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 305/604] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:22:04 2021] GET /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d => generated 1567 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:22:04.384677 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-efea7bb5-3427-461a-b673-ee9b052198b6 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:22:04.385185 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-efea7bb5-3427-461a-b673-ee9b052198b6 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] [instance: bcf45146-f982-459d-96c0-e7af402962e9] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:04.392489 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-efea7bb5-3427-461a-b673-ee9b052198b6 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:04.392934 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-efea7bb5-3427-461a-b673-ee9b052198b6 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:04.393704 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-efea7bb5-3427-461a-b673-ee9b052198b6 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:04.394132 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-efea7bb5-3427-461a-b673-ee9b052198b6 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:04.532675 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-efea7bb5-3427-461a-b673-ee9b052198b6 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b581fa25045cea9585ae4e707585d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5319fd2dee9b4b47b98f59bca1572ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:04.541233 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-efea7bb5-3427-461a-b673-ee9b052198b6 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] 10.222.0.66 "GET /compute/v2.1/servers/bcf45146-f982-459d-96c0-e7af402962e9" status: 200 len: 1318 microversion: 2.1 time: 0.160322 Nov 22 12:22:04.541911 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 306/605] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:22:04 2021] GET /compute/v2.1/servers/bcf45146-f982-459d-96c0-e7af402962e9 => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 12:22:04.947523 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-959bd269-440c-4f96-81ed-26555ef0d1e4 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:22:04.948269 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-959bd269-440c-4f96-81ed-26555ef0d1e4 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] [instance: a3624677-f35c-4a8c-ad79-990ee6987c7b] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:04.955169 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-959bd269-440c-4f96-81ed-26555ef0d1e4 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:04.955646 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-959bd269-440c-4f96-81ed-26555ef0d1e4 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:04.956386 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-959bd269-440c-4f96-81ed-26555ef0d1e4 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:04.956829 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-959bd269-440c-4f96-81ed-26555ef0d1e4 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:05.102341 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-959bd269-440c-4f96-81ed-26555ef0d1e4 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc29a63c701941f9909e8235c80f5ce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc74b1d74b14a009699279eb128f9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:05.111516 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-959bd269-440c-4f96-81ed-26555ef0d1e4 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] 10.222.0.66 "GET /compute/v2.1/servers/a3624677-f35c-4a8c-ad79-990ee6987c7b" status: 200 len: 1512 microversion: 2.1 time: 0.167859 Nov 22 12:22:05.112946 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 307/606] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:22:04 2021] GET /compute/v2.1/servers/a3624677-f35c-4a8c-ad79-990ee6987c7b => generated 1512 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:22:05.159588 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-7cd3196c-ab54-41f8-951d-c0624b7293ea tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:22:05.160425 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-7cd3196c-ab54-41f8-951d-c0624b7293ea tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: c9f6d441-246f-479e-8e88-ea701c0f87ff] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:05.166784 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-7cd3196c-ab54-41f8-951d-c0624b7293ea tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:05.167258 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-7cd3196c-ab54-41f8-951d-c0624b7293ea tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:05.168003 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-7cd3196c-ab54-41f8-951d-c0624b7293ea tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:05.168437 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-7cd3196c-ab54-41f8-951d-c0624b7293ea tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:05.310335 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-7cd3196c-ab54-41f8-951d-c0624b7293ea tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:05.318681 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-7cd3196c-ab54-41f8-951d-c0624b7293ea tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:05.320184 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-7cd3196c-ab54-41f8-951d-c0624b7293ea tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:05.321334 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-7cd3196c-ab54-41f8-951d-c0624b7293ea tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff" status: 200 len: 1724 microversion: 2.20 time: 0.166137 Nov 22 12:22:05.321907 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 308/607] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Nov 22 12:22:05 2021] GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 12:22:05.371857 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-0cae91ab-a4a8-4233-8419-85d3e4497477 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:22:05.372456 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-0cae91ab-a4a8-4233-8419-85d3e4497477 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] [instance: 302ab8ef-5565-4f9b-9b91-b405d550a90d] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:05.378911 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-0cae91ab-a4a8-4233-8419-85d3e4497477 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:05.379398 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-0cae91ab-a4a8-4233-8419-85d3e4497477 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:05.380175 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-0cae91ab-a4a8-4233-8419-85d3e4497477 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:05.380607 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-0cae91ab-a4a8-4233-8419-85d3e4497477 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:05.533744 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-0cae91ab-a4a8-4233-8419-85d3e4497477 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1efac6c215148ce8c3ecdce1e9a8742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d392a7d77f46fcb4faa017786796fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:05.542451 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-0cae91ab-a4a8-4233-8419-85d3e4497477 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] 10.222.0.66 "GET /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d" status: 200 len: 1567 microversion: 2.1 time: 0.174218 Nov 22 12:22:05.543021 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 309/608] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:22:05 2021] GET /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d => generated 1567 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:22:05.558024 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-7d73ff67-a0ed-42a5-b78c-7f8a9ec4aed6 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:22:05.558665 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-7d73ff67-a0ed-42a5-b78c-7f8a9ec4aed6 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] [instance: bcf45146-f982-459d-96c0-e7af402962e9] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:05.566215 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-7d73ff67-a0ed-42a5-b78c-7f8a9ec4aed6 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:05.566215 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-7d73ff67-a0ed-42a5-b78c-7f8a9ec4aed6 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:05.567013 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-7d73ff67-a0ed-42a5-b78c-7f8a9ec4aed6 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:05.567474 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-7d73ff67-a0ed-42a5-b78c-7f8a9ec4aed6 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:05.583280 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-5b6c6dc6-7f66-4ec3-9715-52e95a0aee82 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "POST /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21/action" status: 200 len: 28642 microversion: 2.1 time: 2.780737 Nov 22 12:22:05.583967 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 300/609] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Nov 22 12:22:02 2021] POST /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21/action => generated 28642 bytes in 2782 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 12:22:05.707402 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-7d73ff67-a0ed-42a5-b78c-7f8a9ec4aed6 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b581fa25045cea9585ae4e707585d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5319fd2dee9b4b47b98f59bca1572ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:05.715187 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-7d73ff67-a0ed-42a5-b78c-7f8a9ec4aed6 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] 10.222.0.66 "GET /compute/v2.1/servers/bcf45146-f982-459d-96c0-e7af402962e9" status: 200 len: 1318 microversion: 2.1 time: 0.160869 Nov 22 12:22:05.715792 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 310/610] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:22:05 2021] GET /compute/v2.1/servers/bcf45146-f982-459d-96c0-e7af402962e9 => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:22:06.129713 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-72382bc7-6f37-417e-9402-5b7a130f83d6 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:22:06.130418 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-72382bc7-6f37-417e-9402-5b7a130f83d6 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] [instance: a3624677-f35c-4a8c-ad79-990ee6987c7b] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:06.137481 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-72382bc7-6f37-417e-9402-5b7a130f83d6 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:06.137986 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-72382bc7-6f37-417e-9402-5b7a130f83d6 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:06.138724 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-72382bc7-6f37-417e-9402-5b7a130f83d6 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:06.139168 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-72382bc7-6f37-417e-9402-5b7a130f83d6 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:06.277964 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-72382bc7-6f37-417e-9402-5b7a130f83d6 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc29a63c701941f9909e8235c80f5ce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc74b1d74b14a009699279eb128f9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:06.286251 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-72382bc7-6f37-417e-9402-5b7a130f83d6 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] 10.222.0.66 "GET /compute/v2.1/servers/a3624677-f35c-4a8c-ad79-990ee6987c7b" status: 200 len: 1512 microversion: 2.1 time: 0.160839 Nov 22 12:22:06.286862 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 301/611] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:22:06 2021] GET /compute/v2.1/servers/a3624677-f35c-4a8c-ad79-990ee6987c7b => generated 1512 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 12:22:06.340116 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-1b192765-f796-4313-85f6-60e53f16ed89 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:22:06.340780 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-1b192765-f796-4313-85f6-60e53f16ed89 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: c9f6d441-246f-479e-8e88-ea701c0f87ff] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:06.348602 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-1b192765-f796-4313-85f6-60e53f16ed89 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:06.349192 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-1b192765-f796-4313-85f6-60e53f16ed89 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:06.350099 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-1b192765-f796-4313-85f6-60e53f16ed89 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:06.350605 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-1b192765-f796-4313-85f6-60e53f16ed89 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:06.419044 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [req-5e5f8d9a-74c8-4b26-89f2-1518dee1dc40 req-06eb5496-c86a-4c81-b591-6aea02aa2fd1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3624677-f35c-4a8c-ad79-990ee6987c7b", "name": "network-vif-deleted", "tag": "2dd5ed5d-5998-4e11-8d38-8460b3dd3760"}]} {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:22:06.420659 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 12:22:06.420659 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: warnings.warn(msg) Nov 22 12:22:06.428852 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [req-5e5f8d9a-74c8-4b26-89f2-1518dee1dc40 req-06eb5496-c86a-4c81-b591-6aea02aa2fd1 service nova] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:06.429317 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [req-5e5f8d9a-74c8-4b26-89f2-1518dee1dc40 req-06eb5496-c86a-4c81-b591-6aea02aa2fd1 service nova] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:06.441534 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.compute.server_external_events [req-5e5f8d9a-74c8-4b26-89f2-1518dee1dc40 req-06eb5496-c86a-4c81-b591-6aea02aa2fd1 service nova] Creating event network-vif-deleted:2dd5ed5d-5998-4e11-8d38-8460b3dd3760 for instance a3624677-f35c-4a8c-ad79-990ee6987c7b on hv-cinder-76845 Nov 22 12:22:06.447015 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [req-5e5f8d9a-74c8-4b26-89f2-1518dee1dc40 req-06eb5496-c86a-4c81-b591-6aea02aa2fd1 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032863 Nov 22 12:22:06.450663 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 302/612] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Nov 22 12:22:06 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 12:22:06.503896 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-1b192765-f796-4313-85f6-60e53f16ed89 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:06.512853 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-1b192765-f796-4313-85f6-60e53f16ed89 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:06.514375 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-1b192765-f796-4313-85f6-60e53f16ed89 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:06.516099 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-1b192765-f796-4313-85f6-60e53f16ed89 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff" status: 200 len: 1724 microversion: 2.20 time: 0.179593 Nov 22 12:22:06.516670 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 311/613] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Nov 22 12:22:06 2021] GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff => generated 1724 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 12:22:06.561089 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-5631bc93-3727-484c-80bf-984c64fcef54 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:22:06.561724 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-5631bc93-3727-484c-80bf-984c64fcef54 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] [instance: 302ab8ef-5565-4f9b-9b91-b405d550a90d] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:06.568412 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-5631bc93-3727-484c-80bf-984c64fcef54 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:06.569164 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-5631bc93-3727-484c-80bf-984c64fcef54 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:06.570617 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-5631bc93-3727-484c-80bf-984c64fcef54 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:06.570617 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-5631bc93-3727-484c-80bf-984c64fcef54 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:06.596091 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-7b7f40ea-09d6-492d-8ae2-245e15bfed06 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:22:06.597079 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-7b7f40ea-09d6-492d-8ae2-245e15bfed06 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: 2306113c-8f98-42fd-8c0c-3dfac98fff21] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:06.603336 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-7b7f40ea-09d6-492d-8ae2-245e15bfed06 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:06.603798 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-7b7f40ea-09d6-492d-8ae2-245e15bfed06 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:06.604589 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-7b7f40ea-09d6-492d-8ae2-245e15bfed06 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:06.605218 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-7b7f40ea-09d6-492d-8ae2-245e15bfed06 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:06.692772 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-7b7f40ea-09d6-492d-8ae2-245e15bfed06 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "POST /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21/action" status: 200 len: 28642 microversion: 2.1 time: 0.100996 Nov 22 12:22:06.693453 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 312/614] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Nov 22 12:22:06 2021] POST /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21/action => generated 28642 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 22 12:22:06.732287 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-5631bc93-3727-484c-80bf-984c64fcef54 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1efac6c215148ce8c3ecdce1e9a8742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d392a7d77f46fcb4faa017786796fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:06.733443 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-b0da50b6-591d-4093-a6b6-76eb9a1ae65b tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:22:06.733443 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-b0da50b6-591d-4093-a6b6-76eb9a1ae65b tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] [instance: bcf45146-f982-459d-96c0-e7af402962e9] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:06.740684 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-b0da50b6-591d-4093-a6b6-76eb9a1ae65b tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:06.741129 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-b0da50b6-591d-4093-a6b6-76eb9a1ae65b tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:06.741907 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-b0da50b6-591d-4093-a6b6-76eb9a1ae65b tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:06.742565 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-b0da50b6-591d-4093-a6b6-76eb9a1ae65b tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:06.743804 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-5631bc93-3727-484c-80bf-984c64fcef54 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] 10.222.0.66 "GET /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d" status: 200 len: 1567 microversion: 2.1 time: 0.186644 Nov 22 12:22:06.744600 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 303/615] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:22:06 2021] GET /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d => generated 1567 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:22:06.896437 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-b0da50b6-591d-4093-a6b6-76eb9a1ae65b tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b581fa25045cea9585ae4e707585d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5319fd2dee9b4b47b98f59bca1572ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:06.903692 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-b0da50b6-591d-4093-a6b6-76eb9a1ae65b tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] 10.222.0.66 "GET /compute/v2.1/servers/bcf45146-f982-459d-96c0-e7af402962e9" status: 200 len: 1318 microversion: 2.1 time: 0.175082 Nov 22 12:22:06.904337 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 313/616] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:22:06 2021] GET /compute/v2.1/servers/bcf45146-f982-459d-96c0-e7af402962e9 => generated 1318 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 12:22:07.303503 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-1734f11b-ed41-40e8-a2d4-c29e0f4bb50b tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:22:07.304202 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-1734f11b-ed41-40e8-a2d4-c29e0f4bb50b tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] [instance: a3624677-f35c-4a8c-ad79-990ee6987c7b] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:07.314673 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-1734f11b-ed41-40e8-a2d4-c29e0f4bb50b tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:07.315631 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-1734f11b-ed41-40e8-a2d4-c29e0f4bb50b tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:07.317155 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-1734f11b-ed41-40e8-a2d4-c29e0f4bb50b tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:07.317920 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-1734f11b-ed41-40e8-a2d4-c29e0f4bb50b tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:07.340981 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.wsgi [None req-1734f11b-ed41-40e8-a2d4-c29e0f4bb50b tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] HTTP exception thrown: Instance a3624677-f35c-4a8c-ad79-990ee6987c7b could not be found. Nov 22 12:22:07.341563 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-1734f11b-ed41-40e8-a2d4-c29e0f4bb50b tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Returning 404 to user: Instance a3624677-f35c-4a8c-ad79-990ee6987c7b could not be found. {{(pid=116273) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 12:22:07.342362 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-1734f11b-ed41-40e8-a2d4-c29e0f4bb50b tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] 10.222.0.66 "GET /compute/v2.1/servers/a3624677-f35c-4a8c-ad79-990ee6987c7b" status: 404 len: 111 microversion: 2.1 time: 0.042753 Nov 22 12:22:07.342930 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 304/617] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:22:07 2021] GET /compute/v2.1/servers/a3624677-f35c-4a8c-ad79-990ee6987c7b => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 22 12:22:07.536003 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-b981f807-4e80-437d-985c-02718f980511 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:22:07.536851 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-b981f807-4e80-437d-985c-02718f980511 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: c9f6d441-246f-479e-8e88-ea701c0f87ff] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:07.543609 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-b981f807-4e80-437d-985c-02718f980511 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:07.544263 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-b981f807-4e80-437d-985c-02718f980511 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:07.545057 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-b981f807-4e80-437d-985c-02718f980511 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:07.545748 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-b981f807-4e80-437d-985c-02718f980511 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:07.706275 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-2a619421-0b1a-4eca-a60e-fd5aadcba627 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:22:07.707987 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-2a619421-0b1a-4eca-a60e-fd5aadcba627 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: 2306113c-8f98-42fd-8c0c-3dfac98fff21] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:07.713309 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-b981f807-4e80-437d-985c-02718f980511 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:07.718111 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-2a619421-0b1a-4eca-a60e-fd5aadcba627 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:07.720153 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-2a619421-0b1a-4eca-a60e-fd5aadcba627 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:07.721401 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-2a619421-0b1a-4eca-a60e-fd5aadcba627 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:07.722367 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-2a619421-0b1a-4eca-a60e-fd5aadcba627 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:07.722624 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-b981f807-4e80-437d-985c-02718f980511 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:07.724164 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-b981f807-4e80-437d-985c-02718f980511 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:07.725334 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-b981f807-4e80-437d-985c-02718f980511 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff" status: 200 len: 1724 microversion: 2.20 time: 0.194990 Nov 22 12:22:07.735262 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 314/618] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Nov 22 12:22:07 2021] GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff => generated 1724 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 12:22:07.761107 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-f9d3fdb5-9bfb-41da-94e5-89d88b565985 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:22:07.762010 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-f9d3fdb5-9bfb-41da-94e5-89d88b565985 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] [instance: 302ab8ef-5565-4f9b-9b91-b405d550a90d] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:07.768525 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-f9d3fdb5-9bfb-41da-94e5-89d88b565985 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:07.769199 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-f9d3fdb5-9bfb-41da-94e5-89d88b565985 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:07.770318 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-f9d3fdb5-9bfb-41da-94e5-89d88b565985 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:07.770968 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-f9d3fdb5-9bfb-41da-94e5-89d88b565985 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:07.831185 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-2a619421-0b1a-4eca-a60e-fd5aadcba627 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "POST /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21/action" status: 200 len: 28642 microversion: 2.1 time: 0.130127 Nov 22 12:22:07.832830 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 305/619] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Nov 22 12:22:07 2021] POST /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21/action => generated 28642 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 22 12:22:07.924079 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-4eddf527-e013-4621-9421-35243fc354fc tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:22:07.925150 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-4eddf527-e013-4621-9421-35243fc354fc tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] [instance: bcf45146-f982-459d-96c0-e7af402962e9] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:07.932204 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-4eddf527-e013-4621-9421-35243fc354fc tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:07.933190 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-4eddf527-e013-4621-9421-35243fc354fc tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:07.934304 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-4eddf527-e013-4621-9421-35243fc354fc tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:07.934895 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-4eddf527-e013-4621-9421-35243fc354fc tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:08.027682 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-f9d3fdb5-9bfb-41da-94e5-89d88b565985 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1efac6c215148ce8c3ecdce1e9a8742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d392a7d77f46fcb4faa017786796fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:08.039376 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-f9d3fdb5-9bfb-41da-94e5-89d88b565985 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] 10.222.0.66 "GET /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d" status: 200 len: 1567 microversion: 2.1 time: 0.281960 Nov 22 12:22:08.040004 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 315/620] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:22:07 2021] GET /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d => generated 1567 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 12:22:08.120314 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-4eddf527-e013-4621-9421-35243fc354fc tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b581fa25045cea9585ae4e707585d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5319fd2dee9b4b47b98f59bca1572ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:08.131193 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-4eddf527-e013-4621-9421-35243fc354fc tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] 10.222.0.66 "GET /compute/v2.1/servers/bcf45146-f982-459d-96c0-e7af402962e9" status: 200 len: 1508 microversion: 2.1 time: 0.212935 Nov 22 12:22:08.131798 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 306/621] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:22:07 2021] GET /compute/v2.1/servers/bcf45146-f982-459d-96c0-e7af402962e9 => generated 1508 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 12:22:08.749504 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-cd6e06d8-034f-4c5d-8b6d-061c1205abb0 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:22:08.750207 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-cd6e06d8-034f-4c5d-8b6d-061c1205abb0 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: c9f6d441-246f-479e-8e88-ea701c0f87ff] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:08.756944 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-cd6e06d8-034f-4c5d-8b6d-061c1205abb0 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:08.757583 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-cd6e06d8-034f-4c5d-8b6d-061c1205abb0 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:08.758373 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-cd6e06d8-034f-4c5d-8b6d-061c1205abb0 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:08.758804 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-cd6e06d8-034f-4c5d-8b6d-061c1205abb0 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:08.846183 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-e129e0b4-baac-43f0-9d53-cfcb2be1a851 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:22:08.849864 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-e129e0b4-baac-43f0-9d53-cfcb2be1a851 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: 2306113c-8f98-42fd-8c0c-3dfac98fff21] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:08.861963 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-e129e0b4-baac-43f0-9d53-cfcb2be1a851 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:08.863259 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-e129e0b4-baac-43f0-9d53-cfcb2be1a851 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:08.864693 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-e129e0b4-baac-43f0-9d53-cfcb2be1a851 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:08.865721 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-e129e0b4-baac-43f0-9d53-cfcb2be1a851 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:08.933678 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-cd6e06d8-034f-4c5d-8b6d-061c1205abb0 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:08.942536 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-cd6e06d8-034f-4c5d-8b6d-061c1205abb0 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:08.944084 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-cd6e06d8-034f-4c5d-8b6d-061c1205abb0 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:08.945249 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-cd6e06d8-034f-4c5d-8b6d-061c1205abb0 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff" status: 200 len: 1724 microversion: 2.20 time: 0.199886 Nov 22 12:22:08.946077 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 316/622] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Nov 22 12:22:08 2021] GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff => generated 1724 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 12:22:09.056862 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-1377bc8e-89a1-42b3-a987-5b44c0b0b41a tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:22:09.057479 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-1377bc8e-89a1-42b3-a987-5b44c0b0b41a tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] [instance: 302ab8ef-5565-4f9b-9b91-b405d550a90d] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:09.064822 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-1377bc8e-89a1-42b3-a987-5b44c0b0b41a tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:09.065277 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-1377bc8e-89a1-42b3-a987-5b44c0b0b41a tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:09.066095 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-1377bc8e-89a1-42b3-a987-5b44c0b0b41a tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:09.066521 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-1377bc8e-89a1-42b3-a987-5b44c0b0b41a tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:09.207958 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-1377bc8e-89a1-42b3-a987-5b44c0b0b41a tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1efac6c215148ce8c3ecdce1e9a8742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d392a7d77f46fcb4faa017786796fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:09.216808 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-1377bc8e-89a1-42b3-a987-5b44c0b0b41a tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] 10.222.0.66 "GET /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d" status: 200 len: 1567 microversion: 2.1 time: 0.163459 Nov 22 12:22:09.218332 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 317/623] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:22:09 2021] GET /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d => generated 1567 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:22:09.965051 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-d7747644-4f76-49f2-bd30-6addc901c441 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:22:09.965847 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-d7747644-4f76-49f2-bd30-6addc901c441 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: c9f6d441-246f-479e-8e88-ea701c0f87ff] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:09.974028 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-d7747644-4f76-49f2-bd30-6addc901c441 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:09.974664 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-d7747644-4f76-49f2-bd30-6addc901c441 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:09.975586 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-d7747644-4f76-49f2-bd30-6addc901c441 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:09.976165 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-d7747644-4f76-49f2-bd30-6addc901c441 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:10.130605 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-d7747644-4f76-49f2-bd30-6addc901c441 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:10.141527 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-d7747644-4f76-49f2-bd30-6addc901c441 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:10.143011 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-d7747644-4f76-49f2-bd30-6addc901c441 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:10.144216 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-d7747644-4f76-49f2-bd30-6addc901c441 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff" status: 200 len: 1724 microversion: 2.20 time: 0.183182 Nov 22 12:22:10.144777 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 318/624] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Nov 22 12:22:09 2021] GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff => generated 1724 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 12:22:10.233851 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-ea2c962f-15d7-41e3-ab1f-7edf2b0eba48 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:22:10.234610 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-ea2c962f-15d7-41e3-ab1f-7edf2b0eba48 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] [instance: 302ab8ef-5565-4f9b-9b91-b405d550a90d] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:10.242112 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-ea2c962f-15d7-41e3-ab1f-7edf2b0eba48 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:10.242828 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-ea2c962f-15d7-41e3-ab1f-7edf2b0eba48 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:10.244739 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-ea2c962f-15d7-41e3-ab1f-7edf2b0eba48 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:10.245202 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-ea2c962f-15d7-41e3-ab1f-7edf2b0eba48 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:10.384385 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-ea2c962f-15d7-41e3-ab1f-7edf2b0eba48 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1efac6c215148ce8c3ecdce1e9a8742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d392a7d77f46fcb4faa017786796fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:10.392584 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-ea2c962f-15d7-41e3-ab1f-7edf2b0eba48 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] 10.222.0.66 "GET /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d" status: 200 len: 1567 microversion: 2.1 time: 0.162739 Nov 22 12:22:10.393147 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 319/625] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:22:10 2021] GET /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d => generated 1567 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:22:11.162535 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-5af36e91-4ca4-4534-b42d-7a06a252982d tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:22:11.163191 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-5af36e91-4ca4-4534-b42d-7a06a252982d tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: c9f6d441-246f-479e-8e88-ea701c0f87ff] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:11.169363 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-5af36e91-4ca4-4534-b42d-7a06a252982d tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:11.169802 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-5af36e91-4ca4-4534-b42d-7a06a252982d tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:11.170566 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-5af36e91-4ca4-4534-b42d-7a06a252982d tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:11.170994 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-5af36e91-4ca4-4534-b42d-7a06a252982d tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:11.308003 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-5af36e91-4ca4-4534-b42d-7a06a252982d tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:11.316424 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-5af36e91-4ca4-4534-b42d-7a06a252982d tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:11.318021 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-5af36e91-4ca4-4534-b42d-7a06a252982d tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:11.319246 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-5af36e91-4ca4-4534-b42d-7a06a252982d tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff" status: 200 len: 1724 microversion: 2.20 time: 0.160843 Nov 22 12:22:11.319828 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 320/626] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Nov 22 12:22:11 2021] GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 12:22:11.410597 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-02a10d6e-5a65-42f2-9664-5f581462c417 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:22:11.411191 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-02a10d6e-5a65-42f2-9664-5f581462c417 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] [instance: 302ab8ef-5565-4f9b-9b91-b405d550a90d] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:11.417765 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-02a10d6e-5a65-42f2-9664-5f581462c417 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:11.418151 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-02a10d6e-5a65-42f2-9664-5f581462c417 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:11.418883 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-02a10d6e-5a65-42f2-9664-5f581462c417 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:11.419356 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-02a10d6e-5a65-42f2-9664-5f581462c417 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:11.565285 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-02a10d6e-5a65-42f2-9664-5f581462c417 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1efac6c215148ce8c3ecdce1e9a8742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d392a7d77f46fcb4faa017786796fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:11.568554 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-e129e0b4-baac-43f0-9d53-cfcb2be1a851 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "POST /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21/action" status: 200 len: 28642 microversion: 2.1 time: 2.727920 Nov 22 12:22:11.569444 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 307/627] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Nov 22 12:22:08 2021] POST /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21/action => generated 28642 bytes in 2730 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 22 12:22:11.574060 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-02a10d6e-5a65-42f2-9664-5f581462c417 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] 10.222.0.66 "GET /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d" status: 200 len: 1567 microversion: 2.1 time: 0.167354 Nov 22 12:22:11.574838 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 321/628] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:22:11 2021] GET /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d => generated 1567 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:22:12.338259 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-c35fc40b-564a-4b1e-9951-a6c0d38b0e74 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:22:12.338859 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-c35fc40b-564a-4b1e-9951-a6c0d38b0e74 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: c9f6d441-246f-479e-8e88-ea701c0f87ff] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:12.347728 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-c35fc40b-564a-4b1e-9951-a6c0d38b0e74 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:12.348250 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-c35fc40b-564a-4b1e-9951-a6c0d38b0e74 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:12.349052 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-c35fc40b-564a-4b1e-9951-a6c0d38b0e74 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:12.349487 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-c35fc40b-564a-4b1e-9951-a6c0d38b0e74 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:12.508401 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-c35fc40b-564a-4b1e-9951-a6c0d38b0e74 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:12.516722 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-c35fc40b-564a-4b1e-9951-a6c0d38b0e74 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:12.518230 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-c35fc40b-564a-4b1e-9951-a6c0d38b0e74 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:12.519407 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-c35fc40b-564a-4b1e-9951-a6c0d38b0e74 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff" status: 200 len: 1745 microversion: 2.20 time: 0.185370 Nov 22 12:22:12.519951 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 308/629] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Nov 22 12:22:12 2021] GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff => generated 1745 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 22 12:22:12.580506 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-52f10916-bae4-4e92-a938-0441f5f6491c tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:22:12.582331 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-52f10916-bae4-4e92-a938-0441f5f6491c tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: 2306113c-8f98-42fd-8c0c-3dfac98fff21] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:12.590539 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-d7fc2f5a-2ab3-4d78-9c4b-0ae8c2002ec6 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:22:12.591064 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-d7fc2f5a-2ab3-4d78-9c4b-0ae8c2002ec6 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] [instance: 302ab8ef-5565-4f9b-9b91-b405d550a90d] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:12.596248 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-52f10916-bae4-4e92-a938-0441f5f6491c tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:12.596918 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-52f10916-bae4-4e92-a938-0441f5f6491c tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:12.597897 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-52f10916-bae4-4e92-a938-0441f5f6491c tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:12.598171 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-d7fc2f5a-2ab3-4d78-9c4b-0ae8c2002ec6 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:12.598624 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-d7fc2f5a-2ab3-4d78-9c4b-0ae8c2002ec6 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:12.598839 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-52f10916-bae4-4e92-a938-0441f5f6491c tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:12.599585 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-d7fc2f5a-2ab3-4d78-9c4b-0ae8c2002ec6 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:12.600026 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-d7fc2f5a-2ab3-4d78-9c4b-0ae8c2002ec6 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:12.697305 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-52f10916-bae4-4e92-a938-0441f5f6491c tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "POST /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21/action" status: 200 len: 28642 microversion: 2.1 time: 0.120159 Nov 22 12:22:12.698304 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 322/630] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Nov 22 12:22:12 2021] POST /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21/action => generated 28642 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 12:22:12.788602 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-1dc9f236-7ec5-4810-ac65-da47754aac0f tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "989541a1-99bd-4769-bb28-42fec969c437"}} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:22:12.790073 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-1dc9f236-7ec5-4810-ac65-da47754aac0f tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] [instance: bcf45146-f982-459d-96c0-e7af402962e9] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:12.797595 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-1dc9f236-7ec5-4810-ac65-da47754aac0f tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:12.798292 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-1dc9f236-7ec5-4810-ac65-da47754aac0f tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:12.799351 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-1dc9f236-7ec5-4810-ac65-da47754aac0f tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:12.801155 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-1dc9f236-7ec5-4810-ac65-da47754aac0f tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:12.830550 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-d7fc2f5a-2ab3-4d78-9c4b-0ae8c2002ec6 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1efac6c215148ce8c3ecdce1e9a8742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d392a7d77f46fcb4faa017786796fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:12.844748 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-d7fc2f5a-2ab3-4d78-9c4b-0ae8c2002ec6 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] 10.222.0.66 "GET /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d" status: 200 len: 1567 microversion: 2.1 time: 0.257446 Nov 22 12:22:12.854843 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 309/631] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:22:12 2021] GET /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d => generated 1567 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:22:13.176729 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-1dc9f236-7ec5-4810-ac65-da47754aac0f tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] 10.222.0.66 "POST /compute/v2.1/servers/bcf45146-f982-459d-96c0-e7af402962e9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.392121 Nov 22 12:22:13.184762 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 323/632] 10.222.0.66 () {60 vars in 1322 bytes} [Mon Nov 22 12:22:12 2021] POST /compute/v2.1/servers/bcf45146-f982-459d-96c0-e7af402962e9/os-volume_attachments => generated 194 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 22 12:22:13.537463 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-a291793a-30f1-47e9-ac63-0f4abbb5f9ee tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:22:13.538060 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-a291793a-30f1-47e9-ac63-0f4abbb5f9ee tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: c9f6d441-246f-479e-8e88-ea701c0f87ff] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:13.544733 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-a291793a-30f1-47e9-ac63-0f4abbb5f9ee tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:13.545185 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-a291793a-30f1-47e9-ac63-0f4abbb5f9ee tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:13.546264 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-a291793a-30f1-47e9-ac63-0f4abbb5f9ee tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:13.547070 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-a291793a-30f1-47e9-ac63-0f4abbb5f9ee tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:13.699820 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-a291793a-30f1-47e9-ac63-0f4abbb5f9ee tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:13.710200 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-fceb5a61-c7a5-43e5-9f78-951cb9764938 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:22:13.712021 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-a291793a-30f1-47e9-ac63-0f4abbb5f9ee tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:13.712789 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-fceb5a61-c7a5-43e5-9f78-951cb9764938 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: 2306113c-8f98-42fd-8c0c-3dfac98fff21] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:13.713897 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-a291793a-30f1-47e9-ac63-0f4abbb5f9ee tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:13.715806 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-a291793a-30f1-47e9-ac63-0f4abbb5f9ee tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff" status: 200 len: 1745 microversion: 2.20 time: 0.182298 Nov 22 12:22:13.721202 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-fceb5a61-c7a5-43e5-9f78-951cb9764938 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:13.722131 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-fceb5a61-c7a5-43e5-9f78-951cb9764938 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:13.723160 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-fceb5a61-c7a5-43e5-9f78-951cb9764938 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:13.723832 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-fceb5a61-c7a5-43e5-9f78-951cb9764938 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:13.729554 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 310/633] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Nov 22 12:22:13 2021] GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff => generated 1745 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 12:22:13.806061 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-fceb5a61-c7a5-43e5-9f78-951cb9764938 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "POST /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21/action" status: 200 len: 28642 microversion: 2.1 time: 0.100127 Nov 22 12:22:13.807215 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 324/634] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Nov 22 12:22:13 2021] POST /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21/action => generated 28642 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 22 12:22:13.862049 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-0a7b117a-9364-47fc-ae0b-14ae4fb6b60b tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:22:13.862647 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-0a7b117a-9364-47fc-ae0b-14ae4fb6b60b tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] [instance: 302ab8ef-5565-4f9b-9b91-b405d550a90d] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:13.869571 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-0a7b117a-9364-47fc-ae0b-14ae4fb6b60b tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:13.870010 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-0a7b117a-9364-47fc-ae0b-14ae4fb6b60b tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:13.870791 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-0a7b117a-9364-47fc-ae0b-14ae4fb6b60b tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:13.871427 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-0a7b117a-9364-47fc-ae0b-14ae4fb6b60b tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:14.036058 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-0a7b117a-9364-47fc-ae0b-14ae4fb6b60b tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1efac6c215148ce8c3ecdce1e9a8742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d392a7d77f46fcb4faa017786796fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:14.044510 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-0a7b117a-9364-47fc-ae0b-14ae4fb6b60b tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] 10.222.0.66 "GET /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d" status: 200 len: 1567 microversion: 2.1 time: 0.186449 Nov 22 12:22:14.054550 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 311/635] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:22:13 2021] GET /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d => generated 1567 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:22:14.413013 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-9644b71c-c3bd-4a0a-888e-f37fa0c6676e tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-27376769", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1481680365", "security_groups": [{"name": "tempest-secgroup-smoke-186997840"}], "networks": [{"uuid": "9aa5e7a8-a2f2-453e-b9d2-40a88d8e4e6e"}], "block_device_mapping_v2": [{"uuid": "0706a6d6-cfaa-4cf8-a9b8-32e1fd1374d7", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:22:14.557279 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.network.neutron [None req-9644b71c-c3bd-4a0a-888e-f37fa0c6676e tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] validate_networks() for [('9aa5e7a8-a2f2-453e-b9d2-40a88d8e4e6e', None, None, None, None, None)] {{(pid=116272) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 22 12:22:14.738862 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-1268560d-848f-42b1-bdda-a284d99e1e62 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:22:14.739832 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-1268560d-848f-42b1-bdda-a284d99e1e62 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: c9f6d441-246f-479e-8e88-ea701c0f87ff] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:14.749457 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-1268560d-848f-42b1-bdda-a284d99e1e62 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:14.752201 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-1268560d-848f-42b1-bdda-a284d99e1e62 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:14.753508 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-1268560d-848f-42b1-bdda-a284d99e1e62 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:14.754382 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-1268560d-848f-42b1-bdda-a284d99e1e62 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:14.995405 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-1268560d-848f-42b1-bdda-a284d99e1e62 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:15.009091 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-1268560d-848f-42b1-bdda-a284d99e1e62 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:15.010578 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-1268560d-848f-42b1-bdda-a284d99e1e62 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:15.017499 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-1268560d-848f-42b1-bdda-a284d99e1e62 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff" status: 200 len: 1745 microversion: 2.20 time: 0.285143 Nov 22 12:22:15.028480 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 312/636] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Nov 22 12:22:14 2021] GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff => generated 1745 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 22 12:22:15.030754 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-d1a2f0bc-59f7-45f1-b4a9-63d0e56849e8 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:22:15.032270 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-d1a2f0bc-59f7-45f1-b4a9-63d0e56849e8 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: 2306113c-8f98-42fd-8c0c-3dfac98fff21] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:15.044657 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-d1a2f0bc-59f7-45f1-b4a9-63d0e56849e8 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:15.045537 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-d1a2f0bc-59f7-45f1-b4a9-63d0e56849e8 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:15.046042 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-d1a2f0bc-59f7-45f1-b4a9-63d0e56849e8 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:15.046483 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-d1a2f0bc-59f7-45f1-b4a9-63d0e56849e8 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:15.080108 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.virt.hardware [None req-9644b71c-c3bd-4a0a-888e-f37fa0c6676e tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Flavor limits 0:0:0 {{(pid=116272) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 22 12:22:15.081178 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.virt.hardware [None req-9644b71c-c3bd-4a0a-888e-f37fa0c6676e tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Image limits 0:0:0 {{(pid=116272) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 22 12:22:15.082460 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.virt.hardware [None req-9644b71c-c3bd-4a0a-888e-f37fa0c6676e tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Flavor pref 0:0:0 {{(pid=116272) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 22 12:22:15.083143 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.virt.hardware [None req-9644b71c-c3bd-4a0a-888e-f37fa0c6676e tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Image pref 0:0:0 {{(pid=116272) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 22 12:22:15.083816 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.virt.hardware [None req-9644b71c-c3bd-4a0a-888e-f37fa0c6676e tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116272) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 22 12:22:15.093838 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-9644b71c-c3bd-4a0a-888e-f37fa0c6676e tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:15.094286 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-9644b71c-c3bd-4a0a-888e-f37fa0c6676e tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:15.095399 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-9644b71c-c3bd-4a0a-888e-f37fa0c6676e tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:15.096029 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-9644b71c-c3bd-4a0a-888e-f37fa0c6676e tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:15.117521 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.quota [None req-9644b71c-c3bd-4a0a-888e-f37fa0c6676e tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Getting quotas for project 575f4ae5262e4930b6658095a1aa8a32. Resources: {'ram', 'instances', 'cores'} {{(pid=116272) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 22 12:22:15.122559 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.quota [None req-9644b71c-c3bd-4a0a-888e-f37fa0c6676e tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Getting quotas for user 67c15e2c2fa94be8b638f2257efb5820 and project 575f4ae5262e4930b6658095a1aa8a32. Resources: {'ram', 'instances', 'cores'} {{(pid=116272) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 22 12:22:15.186911 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-9644b71c-c3bd-4a0a-888e-f37fa0c6676e tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Going to run 1 instances... {{(pid=116272) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 22 12:22:15.189126 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-9644b71c-c3bd-4a0a-888e-f37fa0c6676e tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] [instance: 10e112a7-d70a-4499-8be4-fd5e4ab3ec17] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0706a6d6-cfaa-4cf8-a9b8-32e1fd1374d7',volume_size=None,volume_type=None)] {{(pid=116272) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 22 12:22:15.337307 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-9644b71c-c3bd-4a0a-888e-f37fa0c6676e tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.930665 Nov 22 12:22:15.338618 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 325/637] 10.222.0.66 () {60 vars in 1146 bytes} [Mon Nov 22 12:22:14 2021] POST /compute/v2.1/servers => generated 405 bytes in 933 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 22 12:22:15.343292 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-0fa077f5-fc1e-44b9-92ea-92c6f9db5a67 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:22:15.344136 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-0fa077f5-fc1e-44b9-92ea-92c6f9db5a67 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] [instance: 302ab8ef-5565-4f9b-9b91-b405d550a90d] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:15.351461 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-0fa077f5-fc1e-44b9-92ea-92c6f9db5a67 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:15.352272 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-0fa077f5-fc1e-44b9-92ea-92c6f9db5a67 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:15.353234 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-0fa077f5-fc1e-44b9-92ea-92c6f9db5a67 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:15.353818 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-0fa077f5-fc1e-44b9-92ea-92c6f9db5a67 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:15.536516 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-0fa077f5-fc1e-44b9-92ea-92c6f9db5a67 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1efac6c215148ce8c3ecdce1e9a8742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d392a7d77f46fcb4faa017786796fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:15.544759 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-0fa077f5-fc1e-44b9-92ea-92c6f9db5a67 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] 10.222.0.66 "GET /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d" status: 200 len: 1567 microversion: 2.1 time: 0.204804 Nov 22 12:22:15.545565 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 326/638] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:22:15 2021] GET /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d => generated 1567 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:22:15.549883 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-2ed3c59e-55d7-4621-8a55-9089b53221ba tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:22:15.550486 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-2ed3c59e-55d7-4621-8a55-9089b53221ba tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] [instance: 10e112a7-d70a-4499-8be4-fd5e4ab3ec17] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:15.609779 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-2ed3c59e-55d7-4621-8a55-9089b53221ba tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c15e2c2fa94be8b638f2257efb5820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575f4ae5262e4930b6658095a1aa8a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:15.618589 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-2ed3c59e-55d7-4621-8a55-9089b53221ba tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] 10.222.0.66 "GET /compute/v2.1/servers/10e112a7-d70a-4499-8be4-fd5e4ab3ec17" status: 200 len: 1087 microversion: 2.1 time: 0.071584 Nov 22 12:22:15.619791 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 327/639] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:22:15 2021] GET /compute/v2.1/servers/10e112a7-d70a-4499-8be4-fd5e4ab3ec17 => generated 1087 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:22:16.036731 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-b8c92d1a-f184-4840-a6e2-eac5bcafcc10 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:22:16.037971 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-b8c92d1a-f184-4840-a6e2-eac5bcafcc10 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: c9f6d441-246f-479e-8e88-ea701c0f87ff] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:16.044467 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-b8c92d1a-f184-4840-a6e2-eac5bcafcc10 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:16.045315 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-b8c92d1a-f184-4840-a6e2-eac5bcafcc10 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:16.046544 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-b8c92d1a-f184-4840-a6e2-eac5bcafcc10 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:16.047247 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-b8c92d1a-f184-4840-a6e2-eac5bcafcc10 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:16.201584 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-b8c92d1a-f184-4840-a6e2-eac5bcafcc10 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:16.211139 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-b8c92d1a-f184-4840-a6e2-eac5bcafcc10 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:16.212843 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-b8c92d1a-f184-4840-a6e2-eac5bcafcc10 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:16.214289 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-b8c92d1a-f184-4840-a6e2-eac5bcafcc10 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff" status: 200 len: 1745 microversion: 2.20 time: 0.181741 Nov 22 12:22:16.215048 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 328/640] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Nov 22 12:22:16 2021] GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff => generated 1745 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 12:22:16.562831 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-694f7e9f-822f-4c87-87bf-5702a3dff3aa tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:22:16.563745 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-694f7e9f-822f-4c87-87bf-5702a3dff3aa tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] [instance: 302ab8ef-5565-4f9b-9b91-b405d550a90d] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:16.572441 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-694f7e9f-822f-4c87-87bf-5702a3dff3aa tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:16.572989 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-694f7e9f-822f-4c87-87bf-5702a3dff3aa tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:16.573718 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-694f7e9f-822f-4c87-87bf-5702a3dff3aa tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:16.574148 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-694f7e9f-822f-4c87-87bf-5702a3dff3aa tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:16.742381 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-694f7e9f-822f-4c87-87bf-5702a3dff3aa tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1efac6c215148ce8c3ecdce1e9a8742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d392a7d77f46fcb4faa017786796fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:16.753013 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-694f7e9f-822f-4c87-87bf-5702a3dff3aa tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] 10.222.0.66 "GET /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d" status: 200 len: 1567 microversion: 2.1 time: 0.194760 Nov 22 12:22:16.755501 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 329/641] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:22:16 2021] GET /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d => generated 1567 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 12:22:16.760726 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-88fbb901-5b34-4eda-aa20-a22e2edae285 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:22:16.761665 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-88fbb901-5b34-4eda-aa20-a22e2edae285 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] [instance: 10e112a7-d70a-4499-8be4-fd5e4ab3ec17] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:16.769725 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-88fbb901-5b34-4eda-aa20-a22e2edae285 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:16.770490 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-88fbb901-5b34-4eda-aa20-a22e2edae285 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:16.771728 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-88fbb901-5b34-4eda-aa20-a22e2edae285 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:16.772231 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-88fbb901-5b34-4eda-aa20-a22e2edae285 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:16.841832 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-88fbb901-5b34-4eda-aa20-a22e2edae285 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c15e2c2fa94be8b638f2257efb5820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575f4ae5262e4930b6658095a1aa8a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:16.850662 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-88fbb901-5b34-4eda-aa20-a22e2edae285 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] 10.222.0.66 "GET /compute/v2.1/servers/10e112a7-d70a-4499-8be4-fd5e4ab3ec17" status: 200 len: 1137 microversion: 2.1 time: 0.095320 Nov 22 12:22:16.851289 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 330/642] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:22:16 2021] GET /compute/v2.1/servers/10e112a7-d70a-4499-8be4-fd5e4ab3ec17 => generated 1137 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:22:17.233901 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-001eaf64-fd32-4452-a605-adbe9e793672 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:22:17.234753 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-001eaf64-fd32-4452-a605-adbe9e793672 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: c9f6d441-246f-479e-8e88-ea701c0f87ff] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:17.241257 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-001eaf64-fd32-4452-a605-adbe9e793672 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:17.241697 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-001eaf64-fd32-4452-a605-adbe9e793672 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:17.242499 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-001eaf64-fd32-4452-a605-adbe9e793672 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:17.242916 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-001eaf64-fd32-4452-a605-adbe9e793672 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:17.410177 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-001eaf64-fd32-4452-a605-adbe9e793672 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:17.426411 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-001eaf64-fd32-4452-a605-adbe9e793672 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:17.428310 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-001eaf64-fd32-4452-a605-adbe9e793672 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:17.432557 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-001eaf64-fd32-4452-a605-adbe9e793672 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff" status: 200 len: 1745 microversion: 2.20 time: 0.202745 Nov 22 12:22:17.433697 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 331/643] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Nov 22 12:22:17 2021] GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff => generated 1745 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 22 12:22:17.581190 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [req-94af6257-3d79-4552-9236-242cee0f7921 req-822e322a-5f55-4316-83b6-a0e84c08a6f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9f6d441-246f-479e-8e88-ea701c0f87ff", "name": "network-vif-plugged", "status": "completed", "tag": "c3893e14-5c03-4b6a-b17d-c2dc56e8e688"}]} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:22:17.582751 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 12:22:17.582751 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: warnings.warn(msg) Nov 22 12:22:17.594654 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [req-94af6257-3d79-4552-9236-242cee0f7921 req-822e322a-5f55-4316-83b6-a0e84c08a6f1 service nova] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:17.595463 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [req-94af6257-3d79-4552-9236-242cee0f7921 req-822e322a-5f55-4316-83b6-a0e84c08a6f1 service nova] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:17.612835 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.compute.server_external_events [req-94af6257-3d79-4552-9236-242cee0f7921 req-822e322a-5f55-4316-83b6-a0e84c08a6f1 service nova] Creating event network-vif-plugged:c3893e14-5c03-4b6a-b17d-c2dc56e8e688 for instance c9f6d441-246f-479e-8e88-ea701c0f87ff on hv-cinder-76845 Nov 22 12:22:17.618021 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [req-94af6257-3d79-4552-9236-242cee0f7921 req-822e322a-5f55-4316-83b6-a0e84c08a6f1 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040981 Nov 22 12:22:17.619045 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 332/644] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Nov 22 12:22:17 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 22 12:22:17.770644 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-8b53738e-e419-414f-bcc0-c4f0b1f44e43 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:22:17.771181 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-8b53738e-e419-414f-bcc0-c4f0b1f44e43 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] [instance: 302ab8ef-5565-4f9b-9b91-b405d550a90d] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:17.777670 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-8b53738e-e419-414f-bcc0-c4f0b1f44e43 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:17.778187 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-8b53738e-e419-414f-bcc0-c4f0b1f44e43 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:17.779039 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-8b53738e-e419-414f-bcc0-c4f0b1f44e43 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:17.779797 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-8b53738e-e419-414f-bcc0-c4f0b1f44e43 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:17.933756 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-8b53738e-e419-414f-bcc0-c4f0b1f44e43 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1efac6c215148ce8c3ecdce1e9a8742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d392a7d77f46fcb4faa017786796fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:17.945233 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-8b53738e-e419-414f-bcc0-c4f0b1f44e43 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] 10.222.0.66 "GET /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d" status: 200 len: 1567 microversion: 2.1 time: 0.178734 Nov 22 12:22:17.949720 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 333/645] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:22:17 2021] GET /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d => generated 1567 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:22:17.955042 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-cb3ba1f7-d4e4-45df-bad1-ca6ec13c519d tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:22:17.955770 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-cb3ba1f7-d4e4-45df-bad1-ca6ec13c519d tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] [instance: 10e112a7-d70a-4499-8be4-fd5e4ab3ec17] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:17.964485 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-cb3ba1f7-d4e4-45df-bad1-ca6ec13c519d tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:17.965165 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-cb3ba1f7-d4e4-45df-bad1-ca6ec13c519d tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:17.966239 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-cb3ba1f7-d4e4-45df-bad1-ca6ec13c519d tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:17.966836 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-cb3ba1f7-d4e4-45df-bad1-ca6ec13c519d tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:18.038918 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-cb3ba1f7-d4e4-45df-bad1-ca6ec13c519d tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c15e2c2fa94be8b638f2257efb5820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575f4ae5262e4930b6658095a1aa8a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:18.050148 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-cb3ba1f7-d4e4-45df-bad1-ca6ec13c519d tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] 10.222.0.66 "GET /compute/v2.1/servers/10e112a7-d70a-4499-8be4-fd5e4ab3ec17" status: 200 len: 1137 microversion: 2.1 time: 0.099213 Nov 22 12:22:18.050836 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 334/646] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:22:17 2021] GET /compute/v2.1/servers/10e112a7-d70a-4499-8be4-fd5e4ab3ec17 => generated 1137 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:22:18.451819 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-75cc27e8-81ec-46ba-b310-a420077a8d1d tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:22:18.453229 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-75cc27e8-81ec-46ba-b310-a420077a8d1d tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: c9f6d441-246f-479e-8e88-ea701c0f87ff] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:18.459904 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-75cc27e8-81ec-46ba-b310-a420077a8d1d tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:18.460612 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-75cc27e8-81ec-46ba-b310-a420077a8d1d tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:18.461599 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-75cc27e8-81ec-46ba-b310-a420077a8d1d tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:18.462026 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-75cc27e8-81ec-46ba-b310-a420077a8d1d tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:18.564794 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-d1a2f0bc-59f7-45f1-b4a9-63d0e56849e8 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "POST /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21/action" status: 200 len: 28642 microversion: 2.1 time: 3.543123 Nov 22 12:22:18.570512 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 313/647] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Nov 22 12:22:15 2021] POST /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21/action => generated 28642 bytes in 3551 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 12:22:18.650967 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-75cc27e8-81ec-46ba-b310-a420077a8d1d tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:18.660972 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-75cc27e8-81ec-46ba-b310-a420077a8d1d tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:18.662476 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-75cc27e8-81ec-46ba-b310-a420077a8d1d tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:18.663742 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-75cc27e8-81ec-46ba-b310-a420077a8d1d tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff" status: 200 len: 1745 microversion: 2.20 time: 0.215778 Nov 22 12:22:18.664300 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 335/648] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Nov 22 12:22:18 2021] GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff => generated 1745 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 22 12:22:18.963046 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-b0e77f3b-06e7-4e89-843f-3e2fdd9dbaf4 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:22:18.963758 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-b0e77f3b-06e7-4e89-843f-3e2fdd9dbaf4 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] [instance: 302ab8ef-5565-4f9b-9b91-b405d550a90d] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:18.979687 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-b0e77f3b-06e7-4e89-843f-3e2fdd9dbaf4 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:18.980521 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-b0e77f3b-06e7-4e89-843f-3e2fdd9dbaf4 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:18.981554 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-b0e77f3b-06e7-4e89-843f-3e2fdd9dbaf4 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:18.982622 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-b0e77f3b-06e7-4e89-843f-3e2fdd9dbaf4 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:19.068224 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-99fe5d32-de4a-40fc-a632-0c52b9e46be8 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:22:19.068968 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-99fe5d32-de4a-40fc-a632-0c52b9e46be8 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] [instance: 10e112a7-d70a-4499-8be4-fd5e4ab3ec17] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:19.079999 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-99fe5d32-de4a-40fc-a632-0c52b9e46be8 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:19.080452 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-99fe5d32-de4a-40fc-a632-0c52b9e46be8 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:19.081794 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-99fe5d32-de4a-40fc-a632-0c52b9e46be8 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:19.081794 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-99fe5d32-de4a-40fc-a632-0c52b9e46be8 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:19.227702 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-99fe5d32-de4a-40fc-a632-0c52b9e46be8 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c15e2c2fa94be8b638f2257efb5820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575f4ae5262e4930b6658095a1aa8a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:19.240672 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-99fe5d32-de4a-40fc-a632-0c52b9e46be8 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] 10.222.0.66 "GET /compute/v2.1/servers/10e112a7-d70a-4499-8be4-fd5e4ab3ec17" status: 200 len: 1129 microversion: 2.1 time: 0.176591 Nov 22 12:22:19.248624 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 336/649] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:22:19 2021] GET /compute/v2.1/servers/10e112a7-d70a-4499-8be4-fd5e4ab3ec17 => generated 1129 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 12:22:19.291249 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-b0e77f3b-06e7-4e89-843f-3e2fdd9dbaf4 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1efac6c215148ce8c3ecdce1e9a8742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d392a7d77f46fcb4faa017786796fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:19.307508 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-b0e77f3b-06e7-4e89-843f-3e2fdd9dbaf4 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] 10.222.0.66 "GET /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d" status: 200 len: 1567 microversion: 2.1 time: 0.348116 Nov 22 12:22:19.320872 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 314/650] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:22:18 2021] GET /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d => generated 1567 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:22:19.579503 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-fbe2e248-8a29-4783-a449-129b8eec1001 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:22:19.580587 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-fbe2e248-8a29-4783-a449-129b8eec1001 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: 2306113c-8f98-42fd-8c0c-3dfac98fff21] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:19.591720 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-fbe2e248-8a29-4783-a449-129b8eec1001 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:19.592890 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-fbe2e248-8a29-4783-a449-129b8eec1001 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:19.593734 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-fbe2e248-8a29-4783-a449-129b8eec1001 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:19.594173 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-fbe2e248-8a29-4783-a449-129b8eec1001 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:19.595695 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-1c77891e-1403-4778-b598-eb93cd5704fd tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-2089279713", "imageRef": "31affc49-b6f0-44da-af65-4c65d72458b9", "flavorRef": "452", "networks": [{"uuid": "f0e4cddf-9054-45b8-ae14-fd837a61718e"}]}} {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:22:19.677407 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-fbe2e248-8a29-4783-a449-129b8eec1001 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "POST /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21/action" status: 200 len: 28642 microversion: 2.1 time: 0.102910 Nov 22 12:22:19.678334 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 337/651] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Nov 22 12:22:19 2021] POST /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21/action => generated 28642 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 12:22:19.697241 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-214b7750-2ea6-454b-9133-e1bbb486beca tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:22:19.703772 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-214b7750-2ea6-454b-9133-e1bbb486beca tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: c9f6d441-246f-479e-8e88-ea701c0f87ff] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:19.733700 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-214b7750-2ea6-454b-9133-e1bbb486beca tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:19.734203 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-214b7750-2ea6-454b-9133-e1bbb486beca tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:19.735256 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-214b7750-2ea6-454b-9133-e1bbb486beca tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:19.735727 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-214b7750-2ea6-454b-9133-e1bbb486beca tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:19.972210 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-214b7750-2ea6-454b-9133-e1bbb486beca tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:19.986753 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-214b7750-2ea6-454b-9133-e1bbb486beca tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:19.990607 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-214b7750-2ea6-454b-9133-e1bbb486beca tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:19.999524 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-214b7750-2ea6-454b-9133-e1bbb486beca tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff" status: 200 len: 1740 microversion: 2.20 time: 0.314077 Nov 22 12:22:20.000469 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 338/652] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Nov 22 12:22:19 2021] GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff => generated 1740 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 12:22:20.266995 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-842de675-df7d-4217-b9ab-92c1ba7eb70a tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:22:20.268131 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-842de675-df7d-4217-b9ab-92c1ba7eb70a tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] [instance: 10e112a7-d70a-4499-8be4-fd5e4ab3ec17] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:20.322747 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-842de675-df7d-4217-b9ab-92c1ba7eb70a tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:20.323699 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-842de675-df7d-4217-b9ab-92c1ba7eb70a tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:20.342881 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-842de675-df7d-4217-b9ab-92c1ba7eb70a tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:20.344017 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-842de675-df7d-4217-b9ab-92c1ba7eb70a tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:20.601618 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-842de675-df7d-4217-b9ab-92c1ba7eb70a tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c15e2c2fa94be8b638f2257efb5820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575f4ae5262e4930b6658095a1aa8a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:20.631658 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-842de675-df7d-4217-b9ab-92c1ba7eb70a tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] 10.222.0.66 "GET /compute/v2.1/servers/10e112a7-d70a-4499-8be4-fd5e4ab3ec17" status: 200 len: 1203 microversion: 2.1 time: 0.363215 Nov 22 12:22:20.632374 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 339/653] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:22:20 2021] GET /compute/v2.1/servers/10e112a7-d70a-4499-8be4-fd5e4ab3ec17 => generated 1203 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:22:20.641409 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-11ea9169-e5b4-4b58-8a4c-7ff02ee644a9 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:22:20.642037 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-11ea9169-e5b4-4b58-8a4c-7ff02ee644a9 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] [instance: 302ab8ef-5565-4f9b-9b91-b405d550a90d] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:20.678931 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-11ea9169-e5b4-4b58-8a4c-7ff02ee644a9 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:20.679424 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-11ea9169-e5b4-4b58-8a4c-7ff02ee644a9 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:20.680453 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-11ea9169-e5b4-4b58-8a4c-7ff02ee644a9 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:20.681072 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-11ea9169-e5b4-4b58-8a4c-7ff02ee644a9 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:20.922019 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-11ea9169-e5b4-4b58-8a4c-7ff02ee644a9 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1efac6c215148ce8c3ecdce1e9a8742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d392a7d77f46fcb4faa017786796fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:20.931158 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-11ea9169-e5b4-4b58-8a4c-7ff02ee644a9 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] 10.222.0.66 "GET /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d" status: 200 len: 1567 microversion: 2.1 time: 0.294003 Nov 22 12:22:20.931778 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 340/654] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:22:20 2021] GET /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d => generated 1567 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:22:20.936768 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-c3faa05b-1476-4195-9bcd-41240e85d6e0 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:22:20.938230 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-c3faa05b-1476-4195-9bcd-41240e85d6e0 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: 2306113c-8f98-42fd-8c0c-3dfac98fff21] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:20.944861 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-c3faa05b-1476-4195-9bcd-41240e85d6e0 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:20.945405 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-c3faa05b-1476-4195-9bcd-41240e85d6e0 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:20.946284 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-c3faa05b-1476-4195-9bcd-41240e85d6e0 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:20.946811 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-c3faa05b-1476-4195-9bcd-41240e85d6e0 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:21.033066 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-c3faa05b-1476-4195-9bcd-41240e85d6e0 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "POST /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21/action" status: 200 len: 28642 microversion: 2.1 time: 0.099157 Nov 22 12:22:21.033955 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 341/655] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Nov 22 12:22:20 2021] POST /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21/action => generated 28642 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 12:22:21.043068 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-602068a1-d500-4a78-aff4-a7f66187be62 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:22:21.047322 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-602068a1-d500-4a78-aff4-a7f66187be62 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: c9f6d441-246f-479e-8e88-ea701c0f87ff] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:21.067033 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-602068a1-d500-4a78-aff4-a7f66187be62 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:21.067946 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-602068a1-d500-4a78-aff4-a7f66187be62 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:21.068996 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-602068a1-d500-4a78-aff4-a7f66187be62 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:21.070454 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-602068a1-d500-4a78-aff4-a7f66187be62 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:21.398904 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-602068a1-d500-4a78-aff4-a7f66187be62 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:21.416479 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-602068a1-d500-4a78-aff4-a7f66187be62 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:21.420351 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-602068a1-d500-4a78-aff4-a7f66187be62 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:21.423607 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-602068a1-d500-4a78-aff4-a7f66187be62 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff" status: 200 len: 1740 microversion: 2.20 time: 0.386292 Nov 22 12:22:21.427438 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 342/656] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Nov 22 12:22:21 2021] GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff => generated 1740 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 12:22:21.447090 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-b9033c0b-7add-46d4-b1fc-f8dceca833d1 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:22:21.453015 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-b9033c0b-7add-46d4-b1fc-f8dceca833d1 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] [instance: bcf45146-f982-459d-96c0-e7af402962e9] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:21.471349 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-b9033c0b-7add-46d4-b1fc-f8dceca833d1 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:21.473679 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-b9033c0b-7add-46d4-b1fc-f8dceca833d1 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:21.474710 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-b9033c0b-7add-46d4-b1fc-f8dceca833d1 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:21.476641 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-b9033c0b-7add-46d4-b1fc-f8dceca833d1 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:21.812912 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.objects.instance [None req-b9033c0b-7add-46d4-b1fc-f8dceca833d1 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lazy-loading 'services' on Instance uuid bcf45146-f982-459d-96c0-e7af402962e9 {{(pid=116272) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 22 12:22:22.103502 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-b9033c0b-7add-46d4-b1fc-f8dceca833d1 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] 10.222.0.66 "DELETE /compute/v2.1/servers/bcf45146-f982-459d-96c0-e7af402962e9/os-volume_attachments/989541a1-99bd-4769-bb28-42fec969c437" status: 202 len: 0 microversion: 2.1 time: 0.670703 Nov 22 12:22:22.116421 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 343/657] 10.222.0.66 () {58 vars in 1415 bytes} [Mon Nov 22 12:22:21 2021] DELETE /compute/v2.1/servers/bcf45146-f982-459d-96c0-e7af402962e9/os-volume_attachments/989541a1-99bd-4769-bb28-42fec969c437 => generated 0 bytes in 685 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 22 12:22:22.151196 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-204821a0-9202-4695-b607-e8db440a2aa2 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:22:22.155535 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-204821a0-9202-4695-b607-e8db440a2aa2 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] [instance: 10e112a7-d70a-4499-8be4-fd5e4ab3ec17] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:22.195760 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-204821a0-9202-4695-b607-e8db440a2aa2 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:22.201174 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-204821a0-9202-4695-b607-e8db440a2aa2 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:22.206845 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-204821a0-9202-4695-b607-e8db440a2aa2 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:22.212355 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-204821a0-9202-4695-b607-e8db440a2aa2 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:22.479745 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-204821a0-9202-4695-b607-e8db440a2aa2 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c15e2c2fa94be8b638f2257efb5820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575f4ae5262e4930b6658095a1aa8a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:22.495926 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-204821a0-9202-4695-b607-e8db440a2aa2 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] 10.222.0.66 "GET /compute/v2.1/servers/10e112a7-d70a-4499-8be4-fd5e4ab3ec17" status: 200 len: 1258 microversion: 2.1 time: 0.372351 Nov 22 12:22:22.496618 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 344/658] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:22:22 2021] GET /compute/v2.1/servers/10e112a7-d70a-4499-8be4-fd5e4ab3ec17 => generated 1258 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:22:22.513042 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-d9ef5950-aefc-412d-be4b-6d8736b9e737 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:22:22.515943 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-d9ef5950-aefc-412d-be4b-6d8736b9e737 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] [instance: 302ab8ef-5565-4f9b-9b91-b405d550a90d] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:22.539183 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-d9ef5950-aefc-412d-be4b-6d8736b9e737 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:22.539691 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-d9ef5950-aefc-412d-be4b-6d8736b9e737 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:22.540508 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-d9ef5950-aefc-412d-be4b-6d8736b9e737 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:22.540941 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-d9ef5950-aefc-412d-be4b-6d8736b9e737 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:22.863587 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-d9ef5950-aefc-412d-be4b-6d8736b9e737 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1efac6c215148ce8c3ecdce1e9a8742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d392a7d77f46fcb4faa017786796fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:22.873399 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-d9ef5950-aefc-412d-be4b-6d8736b9e737 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] 10.222.0.66 "GET /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d" status: 200 len: 1567 microversion: 2.1 time: 0.368721 Nov 22 12:22:22.878462 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 345/659] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:22:22 2021] GET /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d => generated 1567 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:22:22.887112 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-caf0fb48-284a-4797-8d3a-562b030d6fee tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:22:22.888191 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-caf0fb48-284a-4797-8d3a-562b030d6fee tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: 2306113c-8f98-42fd-8c0c-3dfac98fff21] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:22.902389 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-caf0fb48-284a-4797-8d3a-562b030d6fee tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:22.902841 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-caf0fb48-284a-4797-8d3a-562b030d6fee tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:22.903688 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-caf0fb48-284a-4797-8d3a-562b030d6fee tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:22.904146 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-caf0fb48-284a-4797-8d3a-562b030d6fee tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:23.084933 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-caf0fb48-284a-4797-8d3a-562b030d6fee tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "POST /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21/action" status: 200 len: 29392 microversion: 2.1 time: 0.204835 Nov 22 12:22:23.085750 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 346/660] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Nov 22 12:22:22 2021] POST /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21/action => generated 29392 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 12:22:23.103335 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-29335ff4-38fe-4421-b3f6-5bf4fa378430 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:22:23.112115 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-29335ff4-38fe-4421-b3f6-5bf4fa378430 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] [instance: bcf45146-f982-459d-96c0-e7af402962e9] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:23.138813 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-29335ff4-38fe-4421-b3f6-5bf4fa378430 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:23.140106 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-29335ff4-38fe-4421-b3f6-5bf4fa378430 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:23.144271 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-29335ff4-38fe-4421-b3f6-5bf4fa378430 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:23.144943 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-29335ff4-38fe-4421-b3f6-5bf4fa378430 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:23.234541 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-29335ff4-38fe-4421-b3f6-5bf4fa378430 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] 10.222.0.66 "GET /compute/v2.1/servers/bcf45146-f982-459d-96c0-e7af402962e9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.145964 Nov 22 12:22:23.248098 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 347/661] 10.222.0.66 () {58 vars in 1301 bytes} [Mon Nov 22 12:22:23 2021] GET /compute/v2.1/servers/bcf45146-f982-459d-96c0-e7af402962e9/os-volume_attachments => generated 197 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 12:22:23.262799 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-924bf84d-2936-46e8-a46e-f581788c0402 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:22:23.266651 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-924bf84d-2936-46e8-a46e-f581788c0402 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: c9f6d441-246f-479e-8e88-ea701c0f87ff] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:23.276806 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-924bf84d-2936-46e8-a46e-f581788c0402 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:23.277651 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-924bf84d-2936-46e8-a46e-f581788c0402 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:23.278723 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-924bf84d-2936-46e8-a46e-f581788c0402 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:23.279526 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-924bf84d-2936-46e8-a46e-f581788c0402 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:23.696030 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-924bf84d-2936-46e8-a46e-f581788c0402 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:23.734906 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-924bf84d-2936-46e8-a46e-f581788c0402 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:23.737257 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-924bf84d-2936-46e8-a46e-f581788c0402 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:23.744722 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-924bf84d-2936-46e8-a46e-f581788c0402 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff" status: 200 len: 1740 microversion: 2.20 time: 0.493616 Nov 22 12:22:23.745706 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 348/662] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Nov 22 12:22:23 2021] GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff => generated 1740 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 12:22:23.761491 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [req-ec9fdf9f-0f45-4754-b93d-7c7d020aeb2e req-67a72cb2-5e98-4268-8d48-46dba8884340 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10e112a7-d70a-4499-8be4-fd5e4ab3ec17", "tag": "c27e22cf-346f-4a81-8e7d-d2418b4df811"}]} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:22:23.763259 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 12:22:23.763259 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: warnings.warn(msg) Nov 22 12:22:23.775121 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [req-ec9fdf9f-0f45-4754-b93d-7c7d020aeb2e req-67a72cb2-5e98-4268-8d48-46dba8884340 service nova] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:23.775571 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [req-ec9fdf9f-0f45-4754-b93d-7c7d020aeb2e req-67a72cb2-5e98-4268-8d48-46dba8884340 service nova] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:23.809102 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.compute.server_external_events [req-ec9fdf9f-0f45-4754-b93d-7c7d020aeb2e req-67a72cb2-5e98-4268-8d48-46dba8884340 service nova] Creating event network-changed:c27e22cf-346f-4a81-8e7d-d2418b4df811 for instance 10e112a7-d70a-4499-8be4-fd5e4ab3ec17 on hv-cinder-76845 Nov 22 12:22:23.828586 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [req-ec9fdf9f-0f45-4754-b93d-7c7d020aeb2e req-67a72cb2-5e98-4268-8d48-46dba8884340 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071374 Nov 22 12:22:23.851535 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 349/663] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Nov 22 12:22:23 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 12:22:23.855671 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-c412d30a-a053-4e38-bebb-32fb2db3ccfd tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:22:23.857599 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-c412d30a-a053-4e38-bebb-32fb2db3ccfd tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] [instance: 10e112a7-d70a-4499-8be4-fd5e4ab3ec17] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:23.881616 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-c412d30a-a053-4e38-bebb-32fb2db3ccfd tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:23.882319 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-c412d30a-a053-4e38-bebb-32fb2db3ccfd tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:23.882914 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-c412d30a-a053-4e38-bebb-32fb2db3ccfd tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:23.891892 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-c412d30a-a053-4e38-bebb-32fb2db3ccfd tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:24.188055 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-c412d30a-a053-4e38-bebb-32fb2db3ccfd tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c15e2c2fa94be8b638f2257efb5820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575f4ae5262e4930b6658095a1aa8a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:24.204423 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-c412d30a-a053-4e38-bebb-32fb2db3ccfd tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] 10.222.0.66 "GET /compute/v2.1/servers/10e112a7-d70a-4499-8be4-fd5e4ab3ec17" status: 200 len: 1258 microversion: 2.1 time: 0.364228 Nov 22 12:22:24.213907 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 350/664] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:22:23 2021] GET /compute/v2.1/servers/10e112a7-d70a-4499-8be4-fd5e4ab3ec17 => generated 1258 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:22:24.218742 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-9e85f6c1-7e32-4620-bc73-7d962e9c79db tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:22:24.219494 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-9e85f6c1-7e32-4620-bc73-7d962e9c79db tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] [instance: 302ab8ef-5565-4f9b-9b91-b405d550a90d] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:24.225912 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-9e85f6c1-7e32-4620-bc73-7d962e9c79db tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:24.226477 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-9e85f6c1-7e32-4620-bc73-7d962e9c79db tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:24.227337 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-9e85f6c1-7e32-4620-bc73-7d962e9c79db tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:24.227837 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-9e85f6c1-7e32-4620-bc73-7d962e9c79db tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:24.429296 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-9e85f6c1-7e32-4620-bc73-7d962e9c79db tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1efac6c215148ce8c3ecdce1e9a8742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d392a7d77f46fcb4faa017786796fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:24.438224 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-9e85f6c1-7e32-4620-bc73-7d962e9c79db tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] 10.222.0.66 "GET /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d" status: 200 len: 1567 microversion: 2.1 time: 0.223202 Nov 22 12:22:24.439887 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 351/665] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:22:24 2021] GET /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d => generated 1567 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:22:24.444973 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-0bdd889a-353d-48b8-aec8-e83ee7c2d62b tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:22:24.446262 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-0bdd889a-353d-48b8-aec8-e83ee7c2d62b tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: 2306113c-8f98-42fd-8c0c-3dfac98fff21] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:24.453195 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-0bdd889a-353d-48b8-aec8-e83ee7c2d62b tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:24.453928 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-0bdd889a-353d-48b8-aec8-e83ee7c2d62b tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:24.454911 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-0bdd889a-353d-48b8-aec8-e83ee7c2d62b tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:24.456097 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-0bdd889a-353d-48b8-aec8-e83ee7c2d62b tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:24.572080 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-0bdd889a-353d-48b8-aec8-e83ee7c2d62b tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "POST /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21/action" status: 200 len: 30804 microversion: 2.1 time: 0.130716 Nov 22 12:22:24.573150 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 352/666] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Nov 22 12:22:24 2021] POST /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21/action => generated 30804 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 12:22:24.579720 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-3a8378dd-b2a7-4db4-91ec-7ff4c79c6231 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:22:24.581822 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-3a8378dd-b2a7-4db4-91ec-7ff4c79c6231 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] [instance: bcf45146-f982-459d-96c0-e7af402962e9] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:24.594475 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-3a8378dd-b2a7-4db4-91ec-7ff4c79c6231 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:24.596051 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-3a8378dd-b2a7-4db4-91ec-7ff4c79c6231 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:24.597825 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-3a8378dd-b2a7-4db4-91ec-7ff4c79c6231 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:24.598843 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-3a8378dd-b2a7-4db4-91ec-7ff4c79c6231 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:24.662491 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-3a8378dd-b2a7-4db4-91ec-7ff4c79c6231 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] 10.222.0.66 "GET /compute/v2.1/servers/bcf45146-f982-459d-96c0-e7af402962e9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.087445 Nov 22 12:22:24.664102 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 353/667] 10.222.0.66 () {58 vars in 1301 bytes} [Mon Nov 22 12:22:24 2021] GET /compute/v2.1/servers/bcf45146-f982-459d-96c0-e7af402962e9/os-volume_attachments => generated 25 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 22 12:22:24.789815 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-7f5dd9fa-a304-45c0-bbf8-3c9d13f72478 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:22:24.791207 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-7f5dd9fa-a304-45c0-bbf8-3c9d13f72478 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: c9f6d441-246f-479e-8e88-ea701c0f87ff] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:24.825188 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-7f5dd9fa-a304-45c0-bbf8-3c9d13f72478 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:24.829278 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-7f5dd9fa-a304-45c0-bbf8-3c9d13f72478 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:24.830367 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-7f5dd9fa-a304-45c0-bbf8-3c9d13f72478 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:24.830924 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-7f5dd9fa-a304-45c0-bbf8-3c9d13f72478 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:25.597812 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-7f5dd9fa-a304-45c0-bbf8-3c9d13f72478 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:25.597812 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-7f5dd9fa-a304-45c0-bbf8-3c9d13f72478 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:25.598554 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-7f5dd9fa-a304-45c0-bbf8-3c9d13f72478 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:25.598554 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-7f5dd9fa-a304-45c0-bbf8-3c9d13f72478 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff" status: 200 len: 1740 microversion: 2.20 time: 0.767510 Nov 22 12:22:25.598554 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 354/668] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Nov 22 12:22:24 2021] GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff => generated 1740 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 12:22:25.598554 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-610a6399-f163-413d-a24a-96abff9de157 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:22:25.598911 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-610a6399-f163-413d-a24a-96abff9de157 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] [instance: 10e112a7-d70a-4499-8be4-fd5e4ab3ec17] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:25.598911 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-610a6399-f163-413d-a24a-96abff9de157 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:25.598911 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-610a6399-f163-413d-a24a-96abff9de157 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:25.598911 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-610a6399-f163-413d-a24a-96abff9de157 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:25.599273 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-610a6399-f163-413d-a24a-96abff9de157 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:25.792226 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-610a6399-f163-413d-a24a-96abff9de157 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c15e2c2fa94be8b638f2257efb5820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575f4ae5262e4930b6658095a1aa8a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:25.800654 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-610a6399-f163-413d-a24a-96abff9de157 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] 10.222.0.66 "GET /compute/v2.1/servers/10e112a7-d70a-4499-8be4-fd5e4ab3ec17" status: 200 len: 1258 microversion: 2.1 time: 0.247370 Nov 22 12:22:25.801468 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 355/669] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:22:25 2021] GET /compute/v2.1/servers/10e112a7-d70a-4499-8be4-fd5e4ab3ec17 => generated 1258 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:22:25.820811 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-8dd5b5fb-a99b-4357-b86a-3a562419069b tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:22:25.821916 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-8dd5b5fb-a99b-4357-b86a-3a562419069b tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] [instance: 302ab8ef-5565-4f9b-9b91-b405d550a90d] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:25.830033 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-8dd5b5fb-a99b-4357-b86a-3a562419069b tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:25.830901 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-8dd5b5fb-a99b-4357-b86a-3a562419069b tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:25.832001 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-8dd5b5fb-a99b-4357-b86a-3a562419069b tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:25.832946 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-8dd5b5fb-a99b-4357-b86a-3a562419069b tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:26.002169 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-8dd5b5fb-a99b-4357-b86a-3a562419069b tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1efac6c215148ce8c3ecdce1e9a8742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d392a7d77f46fcb4faa017786796fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:26.010814 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-8dd5b5fb-a99b-4357-b86a-3a562419069b tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] 10.222.0.66 "GET /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d" status: 200 len: 1567 microversion: 2.1 time: 0.194115 Nov 22 12:22:26.011413 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 356/670] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:22:25 2021] GET /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d => generated 1567 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:22:26.016824 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-34f85c74-bcaf-4734-a95e-e65b3fbb2ad7 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:22:26.017788 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-34f85c74-bcaf-4734-a95e-e65b3fbb2ad7 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: 2306113c-8f98-42fd-8c0c-3dfac98fff21] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:26.025975 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-34f85c74-bcaf-4734-a95e-e65b3fbb2ad7 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:26.026687 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-34f85c74-bcaf-4734-a95e-e65b3fbb2ad7 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:26.027724 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-34f85c74-bcaf-4734-a95e-e65b3fbb2ad7 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:26.028376 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-34f85c74-bcaf-4734-a95e-e65b3fbb2ad7 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:26.124905 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-34f85c74-bcaf-4734-a95e-e65b3fbb2ad7 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "POST /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21/action" status: 200 len: 32694 microversion: 2.1 time: 0.111950 Nov 22 12:22:26.126412 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 357/671] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Nov 22 12:22:26 2021] POST /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21/action => generated 32694 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 12:22:26.131947 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-9e8bc4cd-4030-4de7-b5a2-fcac92806903 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:22:26.133390 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-9e8bc4cd-4030-4de7-b5a2-fcac92806903 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] [instance: bcf45146-f982-459d-96c0-e7af402962e9] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:26.142978 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-9e8bc4cd-4030-4de7-b5a2-fcac92806903 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:26.144055 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-9e8bc4cd-4030-4de7-b5a2-fcac92806903 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:26.145303 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-9e8bc4cd-4030-4de7-b5a2-fcac92806903 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:26.146140 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-9e8bc4cd-4030-4de7-b5a2-fcac92806903 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:26.178266 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-9e8bc4cd-4030-4de7-b5a2-fcac92806903 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] [instance: bcf45146-f982-459d-96c0-e7af402962e9] Going to try to terminate instance {{(pid=116272) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 22 12:22:26.357630 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-9e8bc4cd-4030-4de7-b5a2-fcac92806903 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] 10.222.0.66 "DELETE /compute/v2.1/servers/bcf45146-f982-459d-96c0-e7af402962e9" status: 204 len: 0 microversion: 2.1 time: 0.228086 Nov 22 12:22:26.360331 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 358/672] 10.222.0.66 () {58 vars in 1238 bytes} [Mon Nov 22 12:22:26 2021] DELETE /compute/v2.1/servers/bcf45146-f982-459d-96c0-e7af402962e9 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 22 12:22:26.372837 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-b1c4ce92-05db-4659-abac-ade64cb28f62 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:22:26.375017 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-b1c4ce92-05db-4659-abac-ade64cb28f62 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] [instance: bcf45146-f982-459d-96c0-e7af402962e9] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:26.389343 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-b1c4ce92-05db-4659-abac-ade64cb28f62 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:26.392167 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-b1c4ce92-05db-4659-abac-ade64cb28f62 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:26.393522 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-b1c4ce92-05db-4659-abac-ade64cb28f62 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:26.393962 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-b1c4ce92-05db-4659-abac-ade64cb28f62 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:26.617612 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-b1c4ce92-05db-4659-abac-ade64cb28f62 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b581fa25045cea9585ae4e707585d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5319fd2dee9b4b47b98f59bca1572ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:26.627105 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-b1c4ce92-05db-4659-abac-ade64cb28f62 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] 10.222.0.66 "GET /compute/v2.1/servers/bcf45146-f982-459d-96c0-e7af402962e9" status: 200 len: 1514 microversion: 2.1 time: 0.261228 Nov 22 12:22:26.628067 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 359/673] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:22:26 2021] GET /compute/v2.1/servers/bcf45146-f982-459d-96c0-e7af402962e9 => generated 1514 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 12:22:26.633066 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-43ec8e76-225a-4659-8bc5-b286d6b7d79a tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:22:26.633675 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-43ec8e76-225a-4659-8bc5-b286d6b7d79a tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: c9f6d441-246f-479e-8e88-ea701c0f87ff] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:26.641035 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-43ec8e76-225a-4659-8bc5-b286d6b7d79a tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:26.641504 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-43ec8e76-225a-4659-8bc5-b286d6b7d79a tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:26.642325 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-43ec8e76-225a-4659-8bc5-b286d6b7d79a tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:26.642772 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-43ec8e76-225a-4659-8bc5-b286d6b7d79a tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:26.869606 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-43ec8e76-225a-4659-8bc5-b286d6b7d79a tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:26.879438 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-43ec8e76-225a-4659-8bc5-b286d6b7d79a tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:26.888064 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-43ec8e76-225a-4659-8bc5-b286d6b7d79a tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:26.889704 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-43ec8e76-225a-4659-8bc5-b286d6b7d79a tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff" status: 200 len: 1740 microversion: 2.20 time: 0.260569 Nov 22 12:22:26.891430 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 360/674] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Nov 22 12:22:26 2021] GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff => generated 1740 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 12:22:26.896099 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-b4f20d05-c0c1-4229-97a8-62d12c45b79e tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:22:26.896721 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-b4f20d05-c0c1-4229-97a8-62d12c45b79e tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] [instance: 10e112a7-d70a-4499-8be4-fd5e4ab3ec17] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:26.904041 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-b4f20d05-c0c1-4229-97a8-62d12c45b79e tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:26.904618 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-b4f20d05-c0c1-4229-97a8-62d12c45b79e tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:26.905583 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-b4f20d05-c0c1-4229-97a8-62d12c45b79e tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:26.906098 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-b4f20d05-c0c1-4229-97a8-62d12c45b79e tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:27.145500 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-b4f20d05-c0c1-4229-97a8-62d12c45b79e tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c15e2c2fa94be8b638f2257efb5820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575f4ae5262e4930b6658095a1aa8a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:27.159268 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-b4f20d05-c0c1-4229-97a8-62d12c45b79e tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] 10.222.0.66 "GET /compute/v2.1/servers/10e112a7-d70a-4499-8be4-fd5e4ab3ec17" status: 200 len: 1258 microversion: 2.1 time: 0.266638 Nov 22 12:22:27.160726 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 361/675] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:22:26 2021] GET /compute/v2.1/servers/10e112a7-d70a-4499-8be4-fd5e4ab3ec17 => generated 1258 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:22:27.165489 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-4515fa3c-945f-480f-91b0-cc07e98fce8f tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:22:27.166140 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-4515fa3c-945f-480f-91b0-cc07e98fce8f tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] [instance: 302ab8ef-5565-4f9b-9b91-b405d550a90d] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:27.175774 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-4515fa3c-945f-480f-91b0-cc07e98fce8f tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:27.176225 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-4515fa3c-945f-480f-91b0-cc07e98fce8f tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:27.177030 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-4515fa3c-945f-480f-91b0-cc07e98fce8f tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:27.177463 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-4515fa3c-945f-480f-91b0-cc07e98fce8f tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:27.408737 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-4515fa3c-945f-480f-91b0-cc07e98fce8f tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1efac6c215148ce8c3ecdce1e9a8742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d392a7d77f46fcb4faa017786796fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:27.425403 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-4515fa3c-945f-480f-91b0-cc07e98fce8f tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] 10.222.0.66 "GET /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d" status: 200 len: 1567 microversion: 2.1 time: 0.263308 Nov 22 12:22:27.427304 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 362/676] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:22:27 2021] GET /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d => generated 1567 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:22:27.438695 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-8d39d651-cd88-435c-8b03-6b098457b6b8 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:22:27.441607 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-8d39d651-cd88-435c-8b03-6b098457b6b8 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: 2306113c-8f98-42fd-8c0c-3dfac98fff21] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:27.453302 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-8d39d651-cd88-435c-8b03-6b098457b6b8 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:27.454171 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-8d39d651-cd88-435c-8b03-6b098457b6b8 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:27.455263 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-8d39d651-cd88-435c-8b03-6b098457b6b8 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:27.455934 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-8d39d651-cd88-435c-8b03-6b098457b6b8 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:27.579050 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-8d39d651-cd88-435c-8b03-6b098457b6b8 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "POST /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21/action" status: 200 len: 33450 microversion: 2.1 time: 0.148811 Nov 22 12:22:27.587266 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 363/677] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Nov 22 12:22:27 2021] POST /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21/action => generated 33450 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 12:22:27.650463 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-c992003b-35dd-4eb7-97ea-39472b23c4c0 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:22:27.650463 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-c992003b-35dd-4eb7-97ea-39472b23c4c0 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] [instance: bcf45146-f982-459d-96c0-e7af402962e9] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:27.730857 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-c992003b-35dd-4eb7-97ea-39472b23c4c0 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:27.731190 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-c992003b-35dd-4eb7-97ea-39472b23c4c0 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:27.732127 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-c992003b-35dd-4eb7-97ea-39472b23c4c0 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:27.732574 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-c992003b-35dd-4eb7-97ea-39472b23c4c0 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:27.992893 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-c992003b-35dd-4eb7-97ea-39472b23c4c0 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b581fa25045cea9585ae4e707585d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5319fd2dee9b4b47b98f59bca1572ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:28.006235 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-c992003b-35dd-4eb7-97ea-39472b23c4c0 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] 10.222.0.66 "GET /compute/v2.1/servers/bcf45146-f982-459d-96c0-e7af402962e9" status: 200 len: 1514 microversion: 2.1 time: 0.362598 Nov 22 12:22:28.021256 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 364/678] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:22:27 2021] GET /compute/v2.1/servers/bcf45146-f982-459d-96c0-e7af402962e9 => generated 1514 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:22:28.027919 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-5f8a334b-1386-42cf-92a2-53f404ba536a tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:22:28.028849 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-5f8a334b-1386-42cf-92a2-53f404ba536a tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: c9f6d441-246f-479e-8e88-ea701c0f87ff] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:28.050080 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-5f8a334b-1386-42cf-92a2-53f404ba536a tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:28.050571 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-5f8a334b-1386-42cf-92a2-53f404ba536a tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:28.051584 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-5f8a334b-1386-42cf-92a2-53f404ba536a tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:28.054874 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-5f8a334b-1386-42cf-92a2-53f404ba536a tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:28.345516 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-5f8a334b-1386-42cf-92a2-53f404ba536a tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:28.355706 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-5f8a334b-1386-42cf-92a2-53f404ba536a tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:28.357973 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-5f8a334b-1386-42cf-92a2-53f404ba536a tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:28.373542 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-5f8a334b-1386-42cf-92a2-53f404ba536a tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff" status: 200 len: 1740 microversion: 2.20 time: 0.336647 Nov 22 12:22:28.374744 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 365/679] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Nov 22 12:22:28 2021] GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff => generated 1740 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 12:22:28.381179 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-9bb898c7-56cd-4999-b6a9-171a50d0bbd7 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:22:28.382304 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-9bb898c7-56cd-4999-b6a9-171a50d0bbd7 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] [instance: 10e112a7-d70a-4499-8be4-fd5e4ab3ec17] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:28.399720 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-9bb898c7-56cd-4999-b6a9-171a50d0bbd7 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:28.400321 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-9bb898c7-56cd-4999-b6a9-171a50d0bbd7 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:28.401410 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-9bb898c7-56cd-4999-b6a9-171a50d0bbd7 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:28.402069 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-9bb898c7-56cd-4999-b6a9-171a50d0bbd7 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:28.642946 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-9bb898c7-56cd-4999-b6a9-171a50d0bbd7 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c15e2c2fa94be8b638f2257efb5820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575f4ae5262e4930b6658095a1aa8a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:28.653914 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-9bb898c7-56cd-4999-b6a9-171a50d0bbd7 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] 10.222.0.66 "GET /compute/v2.1/servers/10e112a7-d70a-4499-8be4-fd5e4ab3ec17" status: 200 len: 1258 microversion: 2.1 time: 0.277750 Nov 22 12:22:28.655628 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 366/680] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:22:28 2021] GET /compute/v2.1/servers/10e112a7-d70a-4499-8be4-fd5e4ab3ec17 => generated 1258 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:22:28.662063 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-15011a3f-360b-44af-99de-f12cb6389228 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:22:28.663260 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-15011a3f-360b-44af-99de-f12cb6389228 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] [instance: 302ab8ef-5565-4f9b-9b91-b405d550a90d] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:28.671349 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-15011a3f-360b-44af-99de-f12cb6389228 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:28.672225 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-15011a3f-360b-44af-99de-f12cb6389228 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:28.673351 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-15011a3f-360b-44af-99de-f12cb6389228 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:28.674110 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-15011a3f-360b-44af-99de-f12cb6389228 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:28.924991 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-15011a3f-360b-44af-99de-f12cb6389228 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1efac6c215148ce8c3ecdce1e9a8742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d392a7d77f46fcb4faa017786796fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:28.938550 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-15011a3f-360b-44af-99de-f12cb6389228 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] 10.222.0.66 "GET /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d" status: 200 len: 1567 microversion: 2.1 time: 0.281469 Nov 22 12:22:28.947282 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 367/681] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:22:28 2021] GET /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d => generated 1567 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:22:28.952916 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-923fe4ac-439d-4382-9788-ae2723dcdae0 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:22:28.953999 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-923fe4ac-439d-4382-9788-ae2723dcdae0 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: 2306113c-8f98-42fd-8c0c-3dfac98fff21] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:28.968345 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-923fe4ac-439d-4382-9788-ae2723dcdae0 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:28.968973 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-923fe4ac-439d-4382-9788-ae2723dcdae0 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:28.969846 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-923fe4ac-439d-4382-9788-ae2723dcdae0 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:28.970288 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-923fe4ac-439d-4382-9788-ae2723dcdae0 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:29.073549 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-923fe4ac-439d-4382-9788-ae2723dcdae0 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "POST /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21/action" status: 200 len: 34189 microversion: 2.1 time: 0.132860 Nov 22 12:22:29.078485 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 368/682] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Nov 22 12:22:28 2021] POST /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21/action => generated 34189 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 12:22:29.084128 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-abe336e8-e467-4392-9b7b-beb4b8e14960 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:22:29.084842 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-abe336e8-e467-4392-9b7b-beb4b8e14960 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] [instance: bcf45146-f982-459d-96c0-e7af402962e9] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:29.108067 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-abe336e8-e467-4392-9b7b-beb4b8e14960 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:29.108528 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-abe336e8-e467-4392-9b7b-beb4b8e14960 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:29.109356 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-abe336e8-e467-4392-9b7b-beb4b8e14960 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:29.109800 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-abe336e8-e467-4392-9b7b-beb4b8e14960 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:29.387392 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-abe336e8-e467-4392-9b7b-beb4b8e14960 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b581fa25045cea9585ae4e707585d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5319fd2dee9b4b47b98f59bca1572ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:29.398542 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-abe336e8-e467-4392-9b7b-beb4b8e14960 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] 10.222.0.66 "GET /compute/v2.1/servers/bcf45146-f982-459d-96c0-e7af402962e9" status: 200 len: 1514 microversion: 2.1 time: 0.318534 Nov 22 12:22:29.412867 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 369/683] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:22:29 2021] GET /compute/v2.1/servers/bcf45146-f982-459d-96c0-e7af402962e9 => generated 1514 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:22:29.424360 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-6f31f833-5a51-40a8-b987-e3ffbb7edff5 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:22:29.425224 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-6f31f833-5a51-40a8-b987-e3ffbb7edff5 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: c9f6d441-246f-479e-8e88-ea701c0f87ff] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:29.439949 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-6f31f833-5a51-40a8-b987-e3ffbb7edff5 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:29.441746 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-6f31f833-5a51-40a8-b987-e3ffbb7edff5 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:29.444303 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-6f31f833-5a51-40a8-b987-e3ffbb7edff5 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:29.445232 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-6f31f833-5a51-40a8-b987-e3ffbb7edff5 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:29.758153 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-6f31f833-5a51-40a8-b987-e3ffbb7edff5 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:29.781097 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-6f31f833-5a51-40a8-b987-e3ffbb7edff5 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:29.785074 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-6f31f833-5a51-40a8-b987-e3ffbb7edff5 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:29.786441 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-6f31f833-5a51-40a8-b987-e3ffbb7edff5 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff" status: 200 len: 1740 microversion: 2.20 time: 0.371817 Nov 22 12:22:29.787063 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 370/684] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Nov 22 12:22:29 2021] GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff => generated 1740 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 12:22:29.811388 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-55dc2bc1-e4e0-4e90-9de1-037bcfd92012 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:22:29.812017 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-55dc2bc1-e4e0-4e90-9de1-037bcfd92012 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] [instance: 10e112a7-d70a-4499-8be4-fd5e4ab3ec17] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:29.829074 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-55dc2bc1-e4e0-4e90-9de1-037bcfd92012 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:29.829469 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-55dc2bc1-e4e0-4e90-9de1-037bcfd92012 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:29.830994 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-55dc2bc1-e4e0-4e90-9de1-037bcfd92012 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:29.831482 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-55dc2bc1-e4e0-4e90-9de1-037bcfd92012 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:30.186526 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-55dc2bc1-e4e0-4e90-9de1-037bcfd92012 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c15e2c2fa94be8b638f2257efb5820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575f4ae5262e4930b6658095a1aa8a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:30.198193 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-55dc2bc1-e4e0-4e90-9de1-037bcfd92012 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] 10.222.0.66 "GET /compute/v2.1/servers/10e112a7-d70a-4499-8be4-fd5e4ab3ec17" status: 200 len: 1258 microversion: 2.1 time: 0.404652 Nov 22 12:22:30.201089 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 371/685] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:22:29 2021] GET /compute/v2.1/servers/10e112a7-d70a-4499-8be4-fd5e4ab3ec17 => generated 1258 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:22:30.212179 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-b37dcc37-f4f1-4916-b6ed-222a0b53fe0a tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:22:30.212802 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-b37dcc37-f4f1-4916-b6ed-222a0b53fe0a tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] [instance: 302ab8ef-5565-4f9b-9b91-b405d550a90d] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:30.229099 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-b37dcc37-f4f1-4916-b6ed-222a0b53fe0a tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:30.229562 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-b37dcc37-f4f1-4916-b6ed-222a0b53fe0a tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:30.230427 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-b37dcc37-f4f1-4916-b6ed-222a0b53fe0a tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:30.230874 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-b37dcc37-f4f1-4916-b6ed-222a0b53fe0a tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:30.503411 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-b37dcc37-f4f1-4916-b6ed-222a0b53fe0a tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1efac6c215148ce8c3ecdce1e9a8742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d392a7d77f46fcb4faa017786796fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:30.514698 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-b37dcc37-f4f1-4916-b6ed-222a0b53fe0a tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] 10.222.0.66 "GET /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d" status: 200 len: 1567 microversion: 2.1 time: 0.312144 Nov 22 12:22:30.515520 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 372/686] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:22:30 2021] GET /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d => generated 1567 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:22:30.521223 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [req-8fb62b69-d7ff-4732-83e9-d10aa2d6dc96 req-1bb77b3d-1a57-4915-8bc3-9ed7933e9bc6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bcf45146-f982-459d-96c0-e7af402962e9", "name": "network-vif-deleted", "tag": "34ab8e79-23fc-4427-bf02-045bf7c07481"}]} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:22:30.525101 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 12:22:30.525101 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: warnings.warn(msg) Nov 22 12:22:30.540828 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [req-8fb62b69-d7ff-4732-83e9-d10aa2d6dc96 req-1bb77b3d-1a57-4915-8bc3-9ed7933e9bc6 service nova] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:30.541667 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [req-8fb62b69-d7ff-4732-83e9-d10aa2d6dc96 req-1bb77b3d-1a57-4915-8bc3-9ed7933e9bc6 service nova] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:30.593344 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.compute.server_external_events [req-8fb62b69-d7ff-4732-83e9-d10aa2d6dc96 req-1bb77b3d-1a57-4915-8bc3-9ed7933e9bc6 service nova] Creating event network-vif-deleted:34ab8e79-23fc-4427-bf02-045bf7c07481 for instance bcf45146-f982-459d-96c0-e7af402962e9 on hv-cinder-76845 Nov 22 12:22:30.606822 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [req-8fb62b69-d7ff-4732-83e9-d10aa2d6dc96 req-1bb77b3d-1a57-4915-8bc3-9ed7933e9bc6 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089592 Nov 22 12:22:30.608283 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 373/687] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Nov 22 12:22:30 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 12:22:30.622978 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-7cbf84df-d8a0-4372-a69e-31fe46435ed3 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:22:30.627496 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-7cbf84df-d8a0-4372-a69e-31fe46435ed3 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: 2306113c-8f98-42fd-8c0c-3dfac98fff21] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:30.641885 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-7cbf84df-d8a0-4372-a69e-31fe46435ed3 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:30.642475 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-7cbf84df-d8a0-4372-a69e-31fe46435ed3 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:30.645202 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-7cbf84df-d8a0-4372-a69e-31fe46435ed3 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:30.645669 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-7cbf84df-d8a0-4372-a69e-31fe46435ed3 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:30.753040 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.network.neutron [None req-1c77891e-1403-4778-b598-eb93cd5704fd tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] validate_networks() for [('f0e4cddf-9054-45b8-ae14-fd837a61718e', None, None, None, None, None)] {{(pid=116273) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 22 12:22:30.756142 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-7cbf84df-d8a0-4372-a69e-31fe46435ed3 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "POST /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21/action" status: 200 len: 34798 microversion: 2.1 time: 0.145317 Nov 22 12:22:30.757636 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 374/688] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Nov 22 12:22:30 2021] POST /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21/action => generated 34798 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 12:22:30.770969 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-8c29fe61-3b0d-47c0-9a0d-5e6c79615c98 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:22:30.772174 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-8c29fe61-3b0d-47c0-9a0d-5e6c79615c98 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] [instance: bcf45146-f982-459d-96c0-e7af402962e9] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:30.809327 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-8c29fe61-3b0d-47c0-9a0d-5e6c79615c98 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:30.810211 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-8c29fe61-3b0d-47c0-9a0d-5e6c79615c98 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:30.811603 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-8c29fe61-3b0d-47c0-9a0d-5e6c79615c98 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:30.812261 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-8c29fe61-3b0d-47c0-9a0d-5e6c79615c98 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:30.844065 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.wsgi [None req-8c29fe61-3b0d-47c0-9a0d-5e6c79615c98 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] HTTP exception thrown: Instance bcf45146-f982-459d-96c0-e7af402962e9 could not be found. Nov 22 12:22:30.845207 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-8c29fe61-3b0d-47c0-9a0d-5e6c79615c98 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Returning 404 to user: Instance bcf45146-f982-459d-96c0-e7af402962e9 could not be found. {{(pid=116272) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 12:22:30.846854 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-8c29fe61-3b0d-47c0-9a0d-5e6c79615c98 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] 10.222.0.66 "GET /compute/v2.1/servers/bcf45146-f982-459d-96c0-e7af402962e9" status: 404 len: 111 microversion: 2.1 time: 0.088430 Nov 22 12:22:30.851150 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 375/689] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:22:30 2021] GET /compute/v2.1/servers/bcf45146-f982-459d-96c0-e7af402962e9 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 22 12:22:30.859635 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-ab531a5f-a7a5-441d-a2d2-49f6fc8e3986 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:22:30.860077 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-ab531a5f-a7a5-441d-a2d2-49f6fc8e3986 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: c9f6d441-246f-479e-8e88-ea701c0f87ff] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:30.875797 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-ab531a5f-a7a5-441d-a2d2-49f6fc8e3986 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:30.876303 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-ab531a5f-a7a5-441d-a2d2-49f6fc8e3986 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:30.877307 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-ab531a5f-a7a5-441d-a2d2-49f6fc8e3986 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:30.878093 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-ab531a5f-a7a5-441d-a2d2-49f6fc8e3986 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:31.213027 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-ab531a5f-a7a5-441d-a2d2-49f6fc8e3986 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:31.228530 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-ab531a5f-a7a5-441d-a2d2-49f6fc8e3986 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:31.230071 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-ab531a5f-a7a5-441d-a2d2-49f6fc8e3986 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:31.242502 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-ab531a5f-a7a5-441d-a2d2-49f6fc8e3986 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff" status: 200 len: 1740 microversion: 2.20 time: 0.392024 Nov 22 12:22:31.243902 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 376/690] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Nov 22 12:22:30 2021] GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff => generated 1740 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 12:22:31.263034 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-8d24a7cb-8842-4df1-bb81-2fa90c67042f tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:22:31.265819 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-8d24a7cb-8842-4df1-bb81-2fa90c67042f tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] [instance: 10e112a7-d70a-4499-8be4-fd5e4ab3ec17] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:31.272653 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-8d24a7cb-8842-4df1-bb81-2fa90c67042f tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:31.272653 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-8d24a7cb-8842-4df1-bb81-2fa90c67042f tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:31.274810 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-8d24a7cb-8842-4df1-bb81-2fa90c67042f tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:31.274810 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-8d24a7cb-8842-4df1-bb81-2fa90c67042f tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:31.349518 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.virt.hardware [None req-1c77891e-1403-4778-b598-eb93cd5704fd tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Flavor limits 0:0:0 {{(pid=116273) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 22 12:22:31.349518 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.virt.hardware [None req-1c77891e-1403-4778-b598-eb93cd5704fd tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Image limits 0:0:0 {{(pid=116273) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 22 12:22:31.349518 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.virt.hardware [None req-1c77891e-1403-4778-b598-eb93cd5704fd tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Flavor pref 0:0:0 {{(pid=116273) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 22 12:22:31.349518 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.virt.hardware [None req-1c77891e-1403-4778-b598-eb93cd5704fd tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Image pref 0:0:0 {{(pid=116273) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 22 12:22:31.349518 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.virt.hardware [None req-1c77891e-1403-4778-b598-eb93cd5704fd tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116273) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 22 12:22:31.363286 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-1c77891e-1403-4778-b598-eb93cd5704fd tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:31.364073 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-1c77891e-1403-4778-b598-eb93cd5704fd tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:31.365998 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-1c77891e-1403-4778-b598-eb93cd5704fd tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:31.366674 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-1c77891e-1403-4778-b598-eb93cd5704fd tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:31.392065 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.quota [None req-1c77891e-1403-4778-b598-eb93cd5704fd tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Getting quotas for project 8dc74b1d74b14a009699279eb128f9f9. Resources: {'ram', 'instances', 'cores'} {{(pid=116273) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 22 12:22:31.397826 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.quota [None req-1c77891e-1403-4778-b598-eb93cd5704fd tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Getting quotas for user cc29a63c701941f9909e8235c80f5ce5 and project 8dc74b1d74b14a009699279eb128f9f9. Resources: {'ram', 'instances', 'cores'} {{(pid=116273) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 22 12:22:31.415866 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-1c77891e-1403-4778-b598-eb93cd5704fd tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Going to run 1 instances... {{(pid=116273) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 22 12:22:31.420545 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-1c77891e-1403-4778-b598-eb93cd5704fd tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] [instance: 82e102ee-4d06-4e2d-8ce4-2bf3a8d0a874] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='31affc49-b6f0-44da-af65-4c65d72458b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116273) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 22 12:22:31.495024 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-1c77891e-1403-4778-b598-eb93cd5704fd tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 11.902952 Nov 22 12:22:31.496954 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 315/691] 10.222.0.66 () {60 vars in 1146 bytes} [Mon Nov 22 12:22:19 2021] POST /compute/v2.1/servers => generated 380 bytes in 11906 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 22 12:22:31.512541 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-d8f29236-2592-4292-84b8-ef1625632a00 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:22:31.514153 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-d8f29236-2592-4292-84b8-ef1625632a00 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] [instance: 82e102ee-4d06-4e2d-8ce4-2bf3a8d0a874] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:31.530441 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-8d24a7cb-8842-4df1-bb81-2fa90c67042f tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c15e2c2fa94be8b638f2257efb5820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575f4ae5262e4930b6658095a1aa8a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:31.548808 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-8d24a7cb-8842-4df1-bb81-2fa90c67042f tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] 10.222.0.66 "GET /compute/v2.1/servers/10e112a7-d70a-4499-8be4-fd5e4ab3ec17" status: 200 len: 1258 microversion: 2.1 time: 0.290108 Nov 22 12:22:31.550660 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 377/692] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:22:31 2021] GET /compute/v2.1/servers/10e112a7-d70a-4499-8be4-fd5e4ab3ec17 => generated 1258 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:22:31.556218 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-587e1712-2a60-48e8-9a5c-ec60697b8432 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:22:31.556957 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-587e1712-2a60-48e8-9a5c-ec60697b8432 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] [instance: 302ab8ef-5565-4f9b-9b91-b405d550a90d] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:31.567100 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-587e1712-2a60-48e8-9a5c-ec60697b8432 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:31.567907 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-587e1712-2a60-48e8-9a5c-ec60697b8432 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:31.569017 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-587e1712-2a60-48e8-9a5c-ec60697b8432 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:31.569525 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-587e1712-2a60-48e8-9a5c-ec60697b8432 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:31.595242 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-d8f29236-2592-4292-84b8-ef1625632a00 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc29a63c701941f9909e8235c80f5ce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc74b1d74b14a009699279eb128f9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:31.608553 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-d8f29236-2592-4292-84b8-ef1625632a00 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] 10.222.0.66 "GET /compute/v2.1/servers/82e102ee-4d06-4e2d-8ce4-2bf3a8d0a874" status: 200 len: 1219 microversion: 2.1 time: 0.098423 Nov 22 12:22:31.609507 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 316/693] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:22:31 2021] GET /compute/v2.1/servers/82e102ee-4d06-4e2d-8ce4-2bf3a8d0a874 => generated 1219 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:22:31.768794 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-0a9ecced-8a0c-4990-8be8-ce8eb01b76ac tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:22:31.769861 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-0a9ecced-8a0c-4990-8be8-ce8eb01b76ac tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: 2306113c-8f98-42fd-8c0c-3dfac98fff21] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:31.778747 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-0a9ecced-8a0c-4990-8be8-ce8eb01b76ac tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:31.779189 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-0a9ecced-8a0c-4990-8be8-ce8eb01b76ac tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:31.786180 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-0a9ecced-8a0c-4990-8be8-ce8eb01b76ac tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:31.786666 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-0a9ecced-8a0c-4990-8be8-ce8eb01b76ac tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:31.793179 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-587e1712-2a60-48e8-9a5c-ec60697b8432 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1efac6c215148ce8c3ecdce1e9a8742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d392a7d77f46fcb4faa017786796fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:31.808354 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-587e1712-2a60-48e8-9a5c-ec60697b8432 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] 10.222.0.66 "GET /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d" status: 200 len: 1567 microversion: 2.1 time: 0.256436 Nov 22 12:22:31.809784 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 378/694] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:22:31 2021] GET /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d => generated 1567 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:22:31.904501 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-0a9ecced-8a0c-4990-8be8-ce8eb01b76ac tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "POST /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21/action" status: 200 len: 35190 microversion: 2.1 time: 0.139124 Nov 22 12:22:31.906763 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 317/695] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Nov 22 12:22:31 2021] POST /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21/action => generated 35190 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 12:22:32.079624 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-64436ee8-7fbd-43c9-8a92-e11e624e699b tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:22:32.080659 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-64436ee8-7fbd-43c9-8a92-e11e624e699b tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] [instance: d457eff7-4539-4ee1-8c94-c51cd4b5b2c1] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:32.097212 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-64436ee8-7fbd-43c9-8a92-e11e624e699b tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:32.098783 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-64436ee8-7fbd-43c9-8a92-e11e624e699b tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:32.101287 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-64436ee8-7fbd-43c9-8a92-e11e624e699b tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:32.102880 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-64436ee8-7fbd-43c9-8a92-e11e624e699b tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:32.149597 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-64436ee8-7fbd-43c9-8a92-e11e624e699b tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] [instance: d457eff7-4539-4ee1-8c94-c51cd4b5b2c1] Going to try to terminate instance {{(pid=116272) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 22 12:22:32.270675 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-db490ab2-72bb-4213-b785-993271090d95 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:22:32.271954 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-db490ab2-72bb-4213-b785-993271090d95 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: c9f6d441-246f-479e-8e88-ea701c0f87ff] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:32.279050 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-64436ee8-7fbd-43c9-8a92-e11e624e699b tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] 10.222.0.66 "DELETE /compute/v2.1/servers/d457eff7-4539-4ee1-8c94-c51cd4b5b2c1" status: 204 len: 0 microversion: 2.1 time: 0.203973 Nov 22 12:22:32.289638 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 379/696] 10.222.0.66 () {58 vars in 1238 bytes} [Mon Nov 22 12:22:32 2021] DELETE /compute/v2.1/servers/d457eff7-4539-4ee1-8c94-c51cd4b5b2c1 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 22 12:22:32.293236 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-db490ab2-72bb-4213-b785-993271090d95 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:32.294268 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-db490ab2-72bb-4213-b785-993271090d95 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:32.295859 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-db490ab2-72bb-4213-b785-993271090d95 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:32.296543 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-db490ab2-72bb-4213-b785-993271090d95 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:32.311717 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-24152909-d42e-4179-85d4-d4635c1266f2 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:22:32.313118 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-24152909-d42e-4179-85d4-d4635c1266f2 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] [instance: d457eff7-4539-4ee1-8c94-c51cd4b5b2c1] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:32.325944 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-24152909-d42e-4179-85d4-d4635c1266f2 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:32.326906 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-24152909-d42e-4179-85d4-d4635c1266f2 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:32.329538 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-24152909-d42e-4179-85d4-d4635c1266f2 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:32.333474 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-24152909-d42e-4179-85d4-d4635c1266f2 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:32.661543 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-24152909-d42e-4179-85d4-d4635c1266f2 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b581fa25045cea9585ae4e707585d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5319fd2dee9b4b47b98f59bca1572ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:32.674958 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-db490ab2-72bb-4213-b785-993271090d95 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:32.683081 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-24152909-d42e-4179-85d4-d4635c1266f2 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] 10.222.0.66 "GET /compute/v2.1/servers/d457eff7-4539-4ee1-8c94-c51cd4b5b2c1" status: 200 len: 1513 microversion: 2.1 time: 0.386766 Nov 22 12:22:32.686414 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-db490ab2-72bb-4213-b785-993271090d95 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:32.699265 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 380/697] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:22:32 2021] GET /compute/v2.1/servers/d457eff7-4539-4ee1-8c94-c51cd4b5b2c1 => generated 1513 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:22:32.699505 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-db490ab2-72bb-4213-b785-993271090d95 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:32.699505 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-db490ab2-72bb-4213-b785-993271090d95 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff" status: 200 len: 1740 microversion: 2.20 time: 0.432545 Nov 22 12:22:32.699505 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 318/698] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Nov 22 12:22:32 2021] GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff => generated 1740 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 12:22:32.699890 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-e3c719b6-3492-4985-a4ad-af3d02e8710c tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:22:32.699890 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-e3c719b6-3492-4985-a4ad-af3d02e8710c tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] [instance: 10e112a7-d70a-4499-8be4-fd5e4ab3ec17] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:32.711722 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-e3c719b6-3492-4985-a4ad-af3d02e8710c tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:32.712399 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-e3c719b6-3492-4985-a4ad-af3d02e8710c tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:32.713330 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-e3b0001b-ca3e-4523-ae2d-22eb668bb9e0 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:22:32.713569 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-e3c719b6-3492-4985-a4ad-af3d02e8710c tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:32.713979 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-e3b0001b-ca3e-4523-ae2d-22eb668bb9e0 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] [instance: 82e102ee-4d06-4e2d-8ce4-2bf3a8d0a874] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:32.714248 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-e3c719b6-3492-4985-a4ad-af3d02e8710c tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:32.731800 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-e3b0001b-ca3e-4523-ae2d-22eb668bb9e0 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:32.732768 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-e3b0001b-ca3e-4523-ae2d-22eb668bb9e0 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:32.734460 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-e3b0001b-ca3e-4523-ae2d-22eb668bb9e0 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:32.738715 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-e3b0001b-ca3e-4523-ae2d-22eb668bb9e0 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:32.838392 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-e3b0001b-ca3e-4523-ae2d-22eb668bb9e0 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc29a63c701941f9909e8235c80f5ce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc74b1d74b14a009699279eb128f9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:32.853908 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-e3b0001b-ca3e-4523-ae2d-22eb668bb9e0 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] 10.222.0.66 "GET /compute/v2.1/servers/82e102ee-4d06-4e2d-8ce4-2bf3a8d0a874" status: 200 len: 1271 microversion: 2.1 time: 0.155323 Nov 22 12:22:32.855262 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 319/699] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:22:32 2021] GET /compute/v2.1/servers/82e102ee-4d06-4e2d-8ce4-2bf3a8d0a874 => generated 1271 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:22:32.874840 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-cb11a6ef-efea-4cb3-bb8f-79033407bb53 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:22:32.876379 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-cb11a6ef-efea-4cb3-bb8f-79033407bb53 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] [instance: 302ab8ef-5565-4f9b-9b91-b405d550a90d] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:32.893221 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-cb11a6ef-efea-4cb3-bb8f-79033407bb53 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:32.894703 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-cb11a6ef-efea-4cb3-bb8f-79033407bb53 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:32.896795 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-cb11a6ef-efea-4cb3-bb8f-79033407bb53 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:32.897239 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-cb11a6ef-efea-4cb3-bb8f-79033407bb53 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:33.003000 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-e3c719b6-3492-4985-a4ad-af3d02e8710c tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c15e2c2fa94be8b638f2257efb5820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575f4ae5262e4930b6658095a1aa8a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:33.022373 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-e3c719b6-3492-4985-a4ad-af3d02e8710c tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] 10.222.0.66 "GET /compute/v2.1/servers/10e112a7-d70a-4499-8be4-fd5e4ab3ec17" status: 200 len: 1258 microversion: 2.1 time: 0.328170 Nov 22 12:22:33.040616 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 381/700] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:22:32 2021] GET /compute/v2.1/servers/10e112a7-d70a-4499-8be4-fd5e4ab3ec17 => generated 1258 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:22:33.046731 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-96af79bd-04d0-4dfb-a881-6c647863d2dd tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:22:33.048147 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-96af79bd-04d0-4dfb-a881-6c647863d2dd tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: 2306113c-8f98-42fd-8c0c-3dfac98fff21] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:33.055285 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-96af79bd-04d0-4dfb-a881-6c647863d2dd tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:33.056046 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-96af79bd-04d0-4dfb-a881-6c647863d2dd tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:33.057053 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-96af79bd-04d0-4dfb-a881-6c647863d2dd tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:33.057673 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-96af79bd-04d0-4dfb-a881-6c647863d2dd tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:33.143126 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-cb11a6ef-efea-4cb3-bb8f-79033407bb53 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1efac6c215148ce8c3ecdce1e9a8742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d392a7d77f46fcb4faa017786796fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:33.152030 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-cb11a6ef-efea-4cb3-bb8f-79033407bb53 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] 10.222.0.66 "GET /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d" status: 200 len: 1567 microversion: 2.1 time: 0.295145 Nov 22 12:22:33.153009 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 320/701] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:22:32 2021] GET /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d => generated 1567 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:22:33.257919 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-96af79bd-04d0-4dfb-a881-6c647863d2dd tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "POST /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21/action" status: 200 len: 36124 microversion: 2.1 time: 0.214812 Nov 22 12:22:33.258729 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 382/702] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Nov 22 12:22:33 2021] POST /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21/action => generated 36124 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 12:22:33.712771 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-33af0caf-12a3-44f7-992b-3fb49f3af99d tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:22:33.713889 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-33af0caf-12a3-44f7-992b-3fb49f3af99d tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] [instance: d457eff7-4539-4ee1-8c94-c51cd4b5b2c1] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:33.724471 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-0fe23921-1922-46a0-83dc-ea0d8e500046 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:22:33.725483 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-0fe23921-1922-46a0-83dc-ea0d8e500046 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: c9f6d441-246f-479e-8e88-ea701c0f87ff] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:33.726437 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-33af0caf-12a3-44f7-992b-3fb49f3af99d tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:33.727174 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-33af0caf-12a3-44f7-992b-3fb49f3af99d tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:33.729145 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-33af0caf-12a3-44f7-992b-3fb49f3af99d tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:33.730940 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-33af0caf-12a3-44f7-992b-3fb49f3af99d tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:33.746079 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-0fe23921-1922-46a0-83dc-ea0d8e500046 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:33.746608 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-0fe23921-1922-46a0-83dc-ea0d8e500046 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:33.747503 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-0fe23921-1922-46a0-83dc-ea0d8e500046 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:33.747952 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-0fe23921-1922-46a0-83dc-ea0d8e500046 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:34.004441 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-0fe23921-1922-46a0-83dc-ea0d8e500046 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:34.015916 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-0fe23921-1922-46a0-83dc-ea0d8e500046 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:34.017929 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-0fe23921-1922-46a0-83dc-ea0d8e500046 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:34.019430 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-0fe23921-1922-46a0-83dc-ea0d8e500046 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff" status: 200 len: 1740 microversion: 2.20 time: 0.299982 Nov 22 12:22:34.020575 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 383/703] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Nov 22 12:22:33 2021] GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff => generated 1740 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 22 12:22:34.026268 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-7d2a2d55-b0b5-4871-9276-ca914988ca01 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:22:34.027219 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-7d2a2d55-b0b5-4871-9276-ca914988ca01 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] [instance: 82e102ee-4d06-4e2d-8ce4-2bf3a8d0a874] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:34.038175 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-7d2a2d55-b0b5-4871-9276-ca914988ca01 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:34.038968 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-7d2a2d55-b0b5-4871-9276-ca914988ca01 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:34.040095 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-7d2a2d55-b0b5-4871-9276-ca914988ca01 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:34.040767 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-7d2a2d55-b0b5-4871-9276-ca914988ca01 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:34.042061 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-33af0caf-12a3-44f7-992b-3fb49f3af99d tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b581fa25045cea9585ae4e707585d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5319fd2dee9b4b47b98f59bca1572ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:34.056293 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-33af0caf-12a3-44f7-992b-3fb49f3af99d tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] 10.222.0.66 "GET /compute/v2.1/servers/d457eff7-4539-4ee1-8c94-c51cd4b5b2c1" status: 200 len: 1513 microversion: 2.1 time: 0.349305 Nov 22 12:22:34.057053 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 321/704] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:22:33 2021] GET /compute/v2.1/servers/d457eff7-4539-4ee1-8c94-c51cd4b5b2c1 => generated 1513 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:22:34.073018 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-ebc02ac5-a24b-43cb-849a-ffab44676888 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:22:34.073722 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-ebc02ac5-a24b-43cb-849a-ffab44676888 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] [instance: 10e112a7-d70a-4499-8be4-fd5e4ab3ec17] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:34.081988 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-ebc02ac5-a24b-43cb-849a-ffab44676888 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:34.082446 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-ebc02ac5-a24b-43cb-849a-ffab44676888 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:34.083293 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-ebc02ac5-a24b-43cb-849a-ffab44676888 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:34.083727 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-ebc02ac5-a24b-43cb-849a-ffab44676888 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:34.130524 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-7d2a2d55-b0b5-4871-9276-ca914988ca01 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc29a63c701941f9909e8235c80f5ce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc74b1d74b14a009699279eb128f9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:34.143358 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-7d2a2d55-b0b5-4871-9276-ca914988ca01 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] 10.222.0.66 "GET /compute/v2.1/servers/82e102ee-4d06-4e2d-8ce4-2bf3a8d0a874" status: 200 len: 1277 microversion: 2.1 time: 0.121342 Nov 22 12:22:34.148302 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 384/705] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:22:34 2021] GET /compute/v2.1/servers/82e102ee-4d06-4e2d-8ce4-2bf3a8d0a874 => generated 1277 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:22:34.170997 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-b88ccec8-d0a1-4124-8d37-e05926984c1a tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:22:34.171716 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-b88ccec8-d0a1-4124-8d37-e05926984c1a tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] [instance: 302ab8ef-5565-4f9b-9b91-b405d550a90d] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:34.179889 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-b88ccec8-d0a1-4124-8d37-e05926984c1a tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:34.180549 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-b88ccec8-d0a1-4124-8d37-e05926984c1a tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:34.181803 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-b88ccec8-d0a1-4124-8d37-e05926984c1a tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:34.182412 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-b88ccec8-d0a1-4124-8d37-e05926984c1a tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:34.330188 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-ebc02ac5-a24b-43cb-849a-ffab44676888 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c15e2c2fa94be8b638f2257efb5820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575f4ae5262e4930b6658095a1aa8a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:34.355522 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-ebc02ac5-a24b-43cb-849a-ffab44676888 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] 10.222.0.66 "GET /compute/v2.1/servers/10e112a7-d70a-4499-8be4-fd5e4ab3ec17" status: 200 len: 1258 microversion: 2.1 time: 0.286748 Nov 22 12:22:34.356978 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 322/706] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:22:34 2021] GET /compute/v2.1/servers/10e112a7-d70a-4499-8be4-fd5e4ab3ec17 => generated 1258 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:22:34.377408 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-1a667f59-a969-4534-9797-2e5123dcde83 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:22:34.378632 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-1a667f59-a969-4534-9797-2e5123dcde83 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: 2306113c-8f98-42fd-8c0c-3dfac98fff21] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:34.385293 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-1a667f59-a969-4534-9797-2e5123dcde83 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:34.385993 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-1a667f59-a969-4534-9797-2e5123dcde83 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:34.387129 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-1a667f59-a969-4534-9797-2e5123dcde83 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:34.387801 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-1a667f59-a969-4534-9797-2e5123dcde83 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:34.413447 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-b88ccec8-d0a1-4124-8d37-e05926984c1a tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1efac6c215148ce8c3ecdce1e9a8742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d392a7d77f46fcb4faa017786796fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:34.422811 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-b88ccec8-d0a1-4124-8d37-e05926984c1a tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] 10.222.0.66 "GET /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d" status: 200 len: 1567 microversion: 2.1 time: 0.256125 Nov 22 12:22:34.424368 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 385/707] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:22:34 2021] GET /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d => generated 1567 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:22:34.569167 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-1a667f59-a969-4534-9797-2e5123dcde83 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "POST /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21/action" status: 200 len: 36774 microversion: 2.1 time: 0.210419 Nov 22 12:22:34.573753 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 323/708] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Nov 22 12:22:34 2021] POST /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21/action => generated 36774 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 12:22:35.038538 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-9749ee9f-4c24-4159-96e8-b06908703a0e tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:22:35.039784 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-9749ee9f-4c24-4159-96e8-b06908703a0e tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: c9f6d441-246f-479e-8e88-ea701c0f87ff] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:35.048636 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-9749ee9f-4c24-4159-96e8-b06908703a0e tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:35.050027 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-9749ee9f-4c24-4159-96e8-b06908703a0e tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:35.051077 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-9749ee9f-4c24-4159-96e8-b06908703a0e tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:35.051728 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-9749ee9f-4c24-4159-96e8-b06908703a0e tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:35.074504 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-6f81b0a6-8244-4662-96af-dc2d08cfea02 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:22:35.076105 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-6f81b0a6-8244-4662-96af-dc2d08cfea02 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] [instance: d457eff7-4539-4ee1-8c94-c51cd4b5b2c1] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:35.083806 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-6f81b0a6-8244-4662-96af-dc2d08cfea02 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:35.084570 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-6f81b0a6-8244-4662-96af-dc2d08cfea02 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:35.086057 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-6f81b0a6-8244-4662-96af-dc2d08cfea02 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:35.086938 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-6f81b0a6-8244-4662-96af-dc2d08cfea02 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:35.396671 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-9749ee9f-4c24-4159-96e8-b06908703a0e tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:35.409618 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-9749ee9f-4c24-4159-96e8-b06908703a0e tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:35.414917 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-9749ee9f-4c24-4159-96e8-b06908703a0e tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:35.416485 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-9749ee9f-4c24-4159-96e8-b06908703a0e tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff" status: 200 len: 1722 microversion: 2.20 time: 0.382008 Nov 22 12:22:35.427867 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 386/709] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Nov 22 12:22:35 2021] GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff => generated 1722 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 12:22:35.432822 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-adcf8842-2cf2-4f79-880e-f7e781dfc0db tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:22:35.433442 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-adcf8842-2cf2-4f79-880e-f7e781dfc0db tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] [instance: 82e102ee-4d06-4e2d-8ce4-2bf3a8d0a874] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:35.443114 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-adcf8842-2cf2-4f79-880e-f7e781dfc0db tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:35.443634 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-adcf8842-2cf2-4f79-880e-f7e781dfc0db tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:35.444585 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-adcf8842-2cf2-4f79-880e-f7e781dfc0db tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:35.445023 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-adcf8842-2cf2-4f79-880e-f7e781dfc0db tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:35.476495 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-6f81b0a6-8244-4662-96af-dc2d08cfea02 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b581fa25045cea9585ae4e707585d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5319fd2dee9b4b47b98f59bca1572ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:35.492506 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-6f81b0a6-8244-4662-96af-dc2d08cfea02 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] 10.222.0.66 "GET /compute/v2.1/servers/d457eff7-4539-4ee1-8c94-c51cd4b5b2c1" status: 200 len: 1513 microversion: 2.1 time: 0.420541 Nov 22 12:22:35.494298 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 324/710] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:22:35 2021] GET /compute/v2.1/servers/d457eff7-4539-4ee1-8c94-c51cd4b5b2c1 => generated 1513 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 12:22:35.502963 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [req-b7a69ea2-d15d-46c8-b8e3-f98e444ea7cf req-4d17bc89-4dcb-443f-a685-0e488cbfb87e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82e102ee-4d06-4e2d-8ce4-2bf3a8d0a874", "tag": "278a21ab-1eb3-4777-ad07-2e2975db29ac"}]} {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:22:35.506334 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 12:22:35.506334 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: warnings.warn(msg) Nov 22 12:22:35.517247 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [req-b7a69ea2-d15d-46c8-b8e3-f98e444ea7cf req-4d17bc89-4dcb-443f-a685-0e488cbfb87e service nova] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:35.517992 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [req-b7a69ea2-d15d-46c8-b8e3-f98e444ea7cf req-4d17bc89-4dcb-443f-a685-0e488cbfb87e service nova] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:35.530169 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.compute.server_external_events [req-b7a69ea2-d15d-46c8-b8e3-f98e444ea7cf req-4d17bc89-4dcb-443f-a685-0e488cbfb87e service nova] Creating event network-changed:278a21ab-1eb3-4777-ad07-2e2975db29ac for instance 82e102ee-4d06-4e2d-8ce4-2bf3a8d0a874 on hv-cinder-76845 Nov 22 12:22:35.536241 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [req-b7a69ea2-d15d-46c8-b8e3-f98e444ea7cf req-4d17bc89-4dcb-443f-a685-0e488cbfb87e service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040031 Nov 22 12:22:35.537484 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 325/711] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Nov 22 12:22:35 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 12:22:35.542791 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-b771265c-4609-43a9-b1ec-108bb6544509 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:22:35.543983 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-b771265c-4609-43a9-b1ec-108bb6544509 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] [instance: 10e112a7-d70a-4499-8be4-fd5e4ab3ec17] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:35.550859 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-b771265c-4609-43a9-b1ec-108bb6544509 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:35.552221 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-b771265c-4609-43a9-b1ec-108bb6544509 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:35.553464 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-b771265c-4609-43a9-b1ec-108bb6544509 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:35.554362 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-b771265c-4609-43a9-b1ec-108bb6544509 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:35.734638 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-adcf8842-2cf2-4f79-880e-f7e781dfc0db tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc29a63c701941f9909e8235c80f5ce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc74b1d74b14a009699279eb128f9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:35.756721 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-adcf8842-2cf2-4f79-880e-f7e781dfc0db tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] 10.222.0.66 "GET /compute/v2.1/servers/82e102ee-4d06-4e2d-8ce4-2bf3a8d0a874" status: 200 len: 1319 microversion: 2.1 time: 0.327393 Nov 22 12:22:35.760046 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 387/712] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:22:35 2021] GET /compute/v2.1/servers/82e102ee-4d06-4e2d-8ce4-2bf3a8d0a874 => generated 1319 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:22:35.779778 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-7bbd563f-15d6-41aa-92d5-224e8501e82e tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:22:35.785694 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-7bbd563f-15d6-41aa-92d5-224e8501e82e tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] [instance: 302ab8ef-5565-4f9b-9b91-b405d550a90d] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:35.805045 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-7bbd563f-15d6-41aa-92d5-224e8501e82e tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:35.807779 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-7bbd563f-15d6-41aa-92d5-224e8501e82e tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:35.809715 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-7bbd563f-15d6-41aa-92d5-224e8501e82e tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:35.810522 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-7bbd563f-15d6-41aa-92d5-224e8501e82e tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:35.915472 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-b771265c-4609-43a9-b1ec-108bb6544509 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c15e2c2fa94be8b638f2257efb5820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575f4ae5262e4930b6658095a1aa8a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:35.933534 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-b771265c-4609-43a9-b1ec-108bb6544509 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] 10.222.0.66 "GET /compute/v2.1/servers/10e112a7-d70a-4499-8be4-fd5e4ab3ec17" status: 200 len: 1258 microversion: 2.1 time: 0.391999 Nov 22 12:22:35.941594 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 326/713] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:22:35 2021] GET /compute/v2.1/servers/10e112a7-d70a-4499-8be4-fd5e4ab3ec17 => generated 1258 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:22:35.953342 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-6730f8aa-e4c0-46c2-a6c2-4eccd4c5ead3 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:22:35.955480 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-6730f8aa-e4c0-46c2-a6c2-4eccd4c5ead3 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: 2306113c-8f98-42fd-8c0c-3dfac98fff21] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:35.964966 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-6730f8aa-e4c0-46c2-a6c2-4eccd4c5ead3 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:35.966347 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-6730f8aa-e4c0-46c2-a6c2-4eccd4c5ead3 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:35.968199 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-6730f8aa-e4c0-46c2-a6c2-4eccd4c5ead3 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:35.969336 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-6730f8aa-e4c0-46c2-a6c2-4eccd4c5ead3 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:36.065727 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-6730f8aa-e4c0-46c2-a6c2-4eccd4c5ead3 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "POST /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21/action" status: 200 len: 38038 microversion: 2.1 time: 0.119066 Nov 22 12:22:36.066967 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 327/714] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Nov 22 12:22:35 2021] POST /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21/action => generated 38038 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 12:22:36.080578 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [req-8537fb4b-76d4-496c-89f6-d06f61c197f5 req-6032dd46-1628-498c-b5f1-df7c5a3c5b8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10e112a7-d70a-4499-8be4-fd5e4ab3ec17", "name": "network-vif-plugged", "status": "completed", "tag": "c27e22cf-346f-4a81-8e7d-d2418b4df811"}]} {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:22:36.085102 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 12:22:36.085102 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: warnings.warn(msg) Nov 22 12:22:36.096413 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [req-8537fb4b-76d4-496c-89f6-d06f61c197f5 req-6032dd46-1628-498c-b5f1-df7c5a3c5b8a service nova] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:36.099434 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [req-8537fb4b-76d4-496c-89f6-d06f61c197f5 req-6032dd46-1628-498c-b5f1-df7c5a3c5b8a service nova] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:36.122961 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.compute.server_external_events [req-8537fb4b-76d4-496c-89f6-d06f61c197f5 req-6032dd46-1628-498c-b5f1-df7c5a3c5b8a service nova] Creating event network-vif-plugged:c27e22cf-346f-4a81-8e7d-d2418b4df811 for instance 10e112a7-d70a-4499-8be4-fd5e4ab3ec17 on hv-cinder-76845 Nov 22 12:22:36.132612 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [req-8537fb4b-76d4-496c-89f6-d06f61c197f5 req-6032dd46-1628-498c-b5f1-df7c5a3c5b8a service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058877 Nov 22 12:22:36.133702 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 328/715] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Nov 22 12:22:36 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 12:22:36.187566 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-7bbd563f-15d6-41aa-92d5-224e8501e82e tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1efac6c215148ce8c3ecdce1e9a8742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d392a7d77f46fcb4faa017786796fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:36.198940 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-7bbd563f-15d6-41aa-92d5-224e8501e82e tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] 10.222.0.66 "GET /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d" status: 200 len: 1547 microversion: 2.1 time: 0.436743 Nov 22 12:22:36.215869 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 388/716] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:22:35 2021] GET /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d => generated 1547 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:22:36.223610 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-6ef48f0c-bde6-4825-8d12-0b7bda8283ec tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:22:36.224192 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-6ef48f0c-bde6-4825-8d12-0b7bda8283ec tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] [instance: 302ab8ef-5565-4f9b-9b91-b405d550a90d] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:36.233247 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-6ef48f0c-bde6-4825-8d12-0b7bda8283ec tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:36.233698 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-6ef48f0c-bde6-4825-8d12-0b7bda8283ec tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:36.234623 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-6ef48f0c-bde6-4825-8d12-0b7bda8283ec tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:36.235158 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-6ef48f0c-bde6-4825-8d12-0b7bda8283ec tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:36.417244 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.wsgi [None req-6ef48f0c-bde6-4825-8d12-0b7bda8283ec tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] HTTP exception thrown: Cannot 'detach_volume' instance 302ab8ef-5565-4f9b-9b91-b405d550a90d while it is in vm_state rescued Nov 22 12:22:36.417958 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-6ef48f0c-bde6-4825-8d12-0b7bda8283ec tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Returning 409 to user: Cannot 'detach_volume' instance 302ab8ef-5565-4f9b-9b91-b405d550a90d while it is in vm_state rescued {{(pid=116273) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 12:22:36.419484 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-6ef48f0c-bde6-4825-8d12-0b7bda8283ec tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] 10.222.0.66 "DELETE /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d/os-volume_attachments/dd8e16c4-0006-4848-a35a-fcd0386356f1" status: 409 len: 152 microversion: 2.1 time: 0.200536 Nov 22 12:22:36.430473 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-ec5d12e0-8cff-408c-89ec-585f6ecf4800 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:22:36.431724 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-ec5d12e0-8cff-408c-89ec-585f6ecf4800 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] [instance: 302ab8ef-5565-4f9b-9b91-b405d550a90d] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:36.436007 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 329/717] 10.222.0.66 () {58 vars in 1415 bytes} [Mon Nov 22 12:22:36 2021] DELETE /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d/os-volume_attachments/dd8e16c4-0006-4848-a35a-fcd0386356f1 => generated 152 bytes in 218 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 22 12:22:36.441719 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-c584d02f-cd7e-4ac2-bf86-3a3aec5ed015 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:22:36.442666 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-c584d02f-cd7e-4ac2-bf86-3a3aec5ed015 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: c9f6d441-246f-479e-8e88-ea701c0f87ff] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:36.448942 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-ec5d12e0-8cff-408c-89ec-585f6ecf4800 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:36.452061 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-ec5d12e0-8cff-408c-89ec-585f6ecf4800 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:36.453147 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-ec5d12e0-8cff-408c-89ec-585f6ecf4800 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:36.453530 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-c584d02f-cd7e-4ac2-bf86-3a3aec5ed015 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:36.454140 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-c584d02f-cd7e-4ac2-bf86-3a3aec5ed015 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:36.455258 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-c584d02f-cd7e-4ac2-bf86-3a3aec5ed015 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:36.456470 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-c584d02f-cd7e-4ac2-bf86-3a3aec5ed015 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:36.456755 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-ec5d12e0-8cff-408c-89ec-585f6ecf4800 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:36.676800 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-ec5d12e0-8cff-408c-89ec-585f6ecf4800 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] 10.222.0.66 "POST /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d/action" status: 202 len: 0 microversion: 2.1 time: 0.248578 Nov 22 12:22:36.686377 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 389/718] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Nov 22 12:22:36 2021] POST /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d/action => generated 0 bytes in 255 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 22 12:22:36.699136 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-de3d7b18-c4bd-4a65-97d2-b5fecba2bfbe tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:22:36.707267 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-de3d7b18-c4bd-4a65-97d2-b5fecba2bfbe tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] [instance: d457eff7-4539-4ee1-8c94-c51cd4b5b2c1] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:36.721785 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-de3d7b18-c4bd-4a65-97d2-b5fecba2bfbe tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:36.723450 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-de3d7b18-c4bd-4a65-97d2-b5fecba2bfbe tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:36.725445 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-de3d7b18-c4bd-4a65-97d2-b5fecba2bfbe tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:36.726475 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-de3d7b18-c4bd-4a65-97d2-b5fecba2bfbe tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:36.758460 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-c584d02f-cd7e-4ac2-bf86-3a3aec5ed015 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:36.772644 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-c584d02f-cd7e-4ac2-bf86-3a3aec5ed015 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:36.775113 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-c584d02f-cd7e-4ac2-bf86-3a3aec5ed015 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:36.776798 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-c584d02f-cd7e-4ac2-bf86-3a3aec5ed015 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff" status: 200 len: 1722 microversion: 2.20 time: 0.339378 Nov 22 12:22:36.789148 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 330/719] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Nov 22 12:22:36 2021] GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff => generated 1722 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 12:22:36.795008 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [req-dc5e63e5-0e2b-4b98-863b-a5fb741f7a92 req-c42dcc38-6cd1-4a4d-8144-d87e752e1a06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d457eff7-4539-4ee1-8c94-c51cd4b5b2c1", "name": "network-vif-deleted", "tag": "e128f2b8-b093-4adf-809f-77c7db02499c"}]} {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:22:36.797219 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 12:22:36.797219 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: warnings.warn(msg) Nov 22 12:22:36.807866 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [req-dc5e63e5-0e2b-4b98-863b-a5fb741f7a92 req-c42dcc38-6cd1-4a4d-8144-d87e752e1a06 service nova] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:36.808840 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [req-dc5e63e5-0e2b-4b98-863b-a5fb741f7a92 req-c42dcc38-6cd1-4a4d-8144-d87e752e1a06 service nova] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:36.832931 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.compute.server_external_events [req-dc5e63e5-0e2b-4b98-863b-a5fb741f7a92 req-c42dcc38-6cd1-4a4d-8144-d87e752e1a06 service nova] Creating event network-vif-deleted:e128f2b8-b093-4adf-809f-77c7db02499c for instance d457eff7-4539-4ee1-8c94-c51cd4b5b2c1 on hv-cinder-76845 Nov 22 12:22:36.844042 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [req-dc5e63e5-0e2b-4b98-863b-a5fb741f7a92 req-c42dcc38-6cd1-4a4d-8144-d87e752e1a06 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052973 Nov 22 12:22:36.845292 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 331/720] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Nov 22 12:22:36 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 12:22:36.850762 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-4e1aabf3-2151-4751-8234-029d5c6063af tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:22:36.851820 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-4e1aabf3-2151-4751-8234-029d5c6063af tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] [instance: 302ab8ef-5565-4f9b-9b91-b405d550a90d] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:36.861268 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-4e1aabf3-2151-4751-8234-029d5c6063af tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:36.864101 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-4e1aabf3-2151-4751-8234-029d5c6063af tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:36.872902 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-4e1aabf3-2151-4751-8234-029d5c6063af tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:36.873751 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-4e1aabf3-2151-4751-8234-029d5c6063af tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:36.951177 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-de3d7b18-c4bd-4a65-97d2-b5fecba2bfbe tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b581fa25045cea9585ae4e707585d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5319fd2dee9b4b47b98f59bca1572ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:36.960509 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-de3d7b18-c4bd-4a65-97d2-b5fecba2bfbe tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] 10.222.0.66 "GET /compute/v2.1/servers/d457eff7-4539-4ee1-8c94-c51cd4b5b2c1" status: 200 len: 1471 microversion: 2.1 time: 0.277288 Nov 22 12:22:36.961608 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 390/721] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:22:36 2021] GET /compute/v2.1/servers/d457eff7-4539-4ee1-8c94-c51cd4b5b2c1 => generated 1471 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:22:36.966643 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-abeb5b49-787b-4385-be1a-6936bc4cbc12 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:22:36.967302 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-abeb5b49-787b-4385-be1a-6936bc4cbc12 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] [instance: 82e102ee-4d06-4e2d-8ce4-2bf3a8d0a874] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:36.974496 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-abeb5b49-787b-4385-be1a-6936bc4cbc12 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:36.974954 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-abeb5b49-787b-4385-be1a-6936bc4cbc12 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:36.975801 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-abeb5b49-787b-4385-be1a-6936bc4cbc12 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:36.976426 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-abeb5b49-787b-4385-be1a-6936bc4cbc12 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:37.215399 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-4e1aabf3-2151-4751-8234-029d5c6063af tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1efac6c215148ce8c3ecdce1e9a8742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d392a7d77f46fcb4faa017786796fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:37.234760 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-4e1aabf3-2151-4751-8234-029d5c6063af tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] 10.222.0.66 "GET /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d" status: 200 len: 1555 microversion: 2.1 time: 0.386928 Nov 22 12:22:37.236430 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 332/722] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:22:36 2021] GET /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d => generated 1555 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:22:37.246810 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-553ff29e-498f-4855-8b9f-ada688be4513 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:22:37.248505 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-553ff29e-498f-4855-8b9f-ada688be4513 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] [instance: 10e112a7-d70a-4499-8be4-fd5e4ab3ec17] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:37.258432 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-553ff29e-498f-4855-8b9f-ada688be4513 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:37.259678 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-553ff29e-498f-4855-8b9f-ada688be4513 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:37.261662 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-553ff29e-498f-4855-8b9f-ada688be4513 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:37.262685 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-553ff29e-498f-4855-8b9f-ada688be4513 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:37.582967 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-abeb5b49-787b-4385-be1a-6936bc4cbc12 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc29a63c701941f9909e8235c80f5ce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc74b1d74b14a009699279eb128f9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:37.614475 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-abeb5b49-787b-4385-be1a-6936bc4cbc12 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] 10.222.0.66 "GET /compute/v2.1/servers/82e102ee-4d06-4e2d-8ce4-2bf3a8d0a874" status: 200 len: 1319 microversion: 2.1 time: 0.651416 Nov 22 12:22:37.615871 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 391/723] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:22:36 2021] GET /compute/v2.1/servers/82e102ee-4d06-4e2d-8ce4-2bf3a8d0a874 => generated 1319 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:22:37.620858 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-03508e51-2b93-4a94-9920-a33bf9f45600 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:22:37.622832 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-03508e51-2b93-4a94-9920-a33bf9f45600 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: 2306113c-8f98-42fd-8c0c-3dfac98fff21] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:37.639292 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-03508e51-2b93-4a94-9920-a33bf9f45600 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:37.639838 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-03508e51-2b93-4a94-9920-a33bf9f45600 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:37.641414 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-03508e51-2b93-4a94-9920-a33bf9f45600 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:37.651398 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-03508e51-2b93-4a94-9920-a33bf9f45600 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:37.774012 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-553ff29e-498f-4855-8b9f-ada688be4513 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c15e2c2fa94be8b638f2257efb5820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575f4ae5262e4930b6658095a1aa8a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:37.783013 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-553ff29e-498f-4855-8b9f-ada688be4513 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] 10.222.0.66 "GET /compute/v2.1/servers/10e112a7-d70a-4499-8be4-fd5e4ab3ec17" status: 200 len: 1258 microversion: 2.1 time: 0.544491 Nov 22 12:22:37.786799 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 333/724] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:22:37 2021] GET /compute/v2.1/servers/10e112a7-d70a-4499-8be4-fd5e4ab3ec17 => generated 1258 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:22:37.799061 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-03508e51-2b93-4a94-9920-a33bf9f45600 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "POST /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21/action" status: 200 len: 38144 microversion: 2.1 time: 0.181530 Nov 22 12:22:37.800982 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 392/725] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Nov 22 12:22:37 2021] POST /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21/action => generated 38144 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 12:22:37.803343 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-f71513f2-e87a-426d-a18c-b9d4e1431440 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:22:37.804273 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-f71513f2-e87a-426d-a18c-b9d4e1431440 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: c9f6d441-246f-479e-8e88-ea701c0f87ff] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:37.815542 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-f71513f2-e87a-426d-a18c-b9d4e1431440 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:37.816412 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-f71513f2-e87a-426d-a18c-b9d4e1431440 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:37.817420 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-f71513f2-e87a-426d-a18c-b9d4e1431440 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:37.818130 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-f71513f2-e87a-426d-a18c-b9d4e1431440 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:37.979222 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-090e6576-693b-4b35-b987-ef7977a429e3 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:22:37.980595 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-090e6576-693b-4b35-b987-ef7977a429e3 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] [instance: d457eff7-4539-4ee1-8c94-c51cd4b5b2c1] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:37.988692 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-090e6576-693b-4b35-b987-ef7977a429e3 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:37.990039 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-090e6576-693b-4b35-b987-ef7977a429e3 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:37.991184 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-090e6576-693b-4b35-b987-ef7977a429e3 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:37.991974 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-090e6576-693b-4b35-b987-ef7977a429e3 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:38.009341 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.wsgi [None req-090e6576-693b-4b35-b987-ef7977a429e3 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] HTTP exception thrown: Instance d457eff7-4539-4ee1-8c94-c51cd4b5b2c1 could not be found. Nov 22 12:22:38.010280 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-090e6576-693b-4b35-b987-ef7977a429e3 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Returning 404 to user: Instance d457eff7-4539-4ee1-8c94-c51cd4b5b2c1 could not be found. {{(pid=116272) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 12:22:38.011458 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-090e6576-693b-4b35-b987-ef7977a429e3 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] 10.222.0.66 "GET /compute/v2.1/servers/d457eff7-4539-4ee1-8c94-c51cd4b5b2c1" status: 404 len: 111 microversion: 2.1 time: 0.036467 Nov 22 12:22:38.012312 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 393/726] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:22:37 2021] GET /compute/v2.1/servers/d457eff7-4539-4ee1-8c94-c51cd4b5b2c1 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 22 12:22:38.022288 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-bee489fc-eb73-49d5-8666-1124dcf8986c tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:22:38.022575 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-bee489fc-eb73-49d5-8666-1124dcf8986c tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] [instance: 8412ba15-56d4-416c-ade2-50b31de5ccb9] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:38.029896 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-bee489fc-eb73-49d5-8666-1124dcf8986c tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:38.030640 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-bee489fc-eb73-49d5-8666-1124dcf8986c tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:38.031775 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-bee489fc-eb73-49d5-8666-1124dcf8986c tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:38.032763 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-bee489fc-eb73-49d5-8666-1124dcf8986c tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:38.069329 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-bee489fc-eb73-49d5-8666-1124dcf8986c tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] [instance: 8412ba15-56d4-416c-ade2-50b31de5ccb9] Going to try to terminate instance {{(pid=116272) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 22 12:22:38.164712 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-bee489fc-eb73-49d5-8666-1124dcf8986c tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] 10.222.0.66 "DELETE /compute/v2.1/servers/8412ba15-56d4-416c-ade2-50b31de5ccb9" status: 204 len: 0 microversion: 2.1 time: 0.145505 Nov 22 12:22:38.170403 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 394/727] 10.222.0.66 () {58 vars in 1238 bytes} [Mon Nov 22 12:22:38 2021] DELETE /compute/v2.1/servers/8412ba15-56d4-416c-ade2-50b31de5ccb9 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 22 12:22:38.180584 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-d1d37a3c-b9d5-4203-984f-85828a448514 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:22:38.181878 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-d1d37a3c-b9d5-4203-984f-85828a448514 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] [instance: 8412ba15-56d4-416c-ade2-50b31de5ccb9] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:38.193147 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-d1d37a3c-b9d5-4203-984f-85828a448514 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:38.194422 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-d1d37a3c-b9d5-4203-984f-85828a448514 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:38.195215 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-d1d37a3c-b9d5-4203-984f-85828a448514 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:38.195986 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-d1d37a3c-b9d5-4203-984f-85828a448514 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:38.206510 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-f71513f2-e87a-426d-a18c-b9d4e1431440 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:38.215530 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-f71513f2-e87a-426d-a18c-b9d4e1431440 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:38.218041 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-f71513f2-e87a-426d-a18c-b9d4e1431440 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:38.219597 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-f71513f2-e87a-426d-a18c-b9d4e1431440 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff" status: 200 len: 1722 microversion: 2.20 time: 0.426110 Nov 22 12:22:38.231137 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 334/728] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Nov 22 12:22:37 2021] GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff => generated 1722 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 12:22:38.254430 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-0127bd26-8c52-4eea-9624-3c997b837c04 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:22:38.255165 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-0127bd26-8c52-4eea-9624-3c997b837c04 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] [instance: 302ab8ef-5565-4f9b-9b91-b405d550a90d] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:38.263843 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-0127bd26-8c52-4eea-9624-3c997b837c04 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:38.264397 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-0127bd26-8c52-4eea-9624-3c997b837c04 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:38.265293 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-0127bd26-8c52-4eea-9624-3c997b837c04 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:38.265797 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-0127bd26-8c52-4eea-9624-3c997b837c04 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:38.512084 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-d1d37a3c-b9d5-4203-984f-85828a448514 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b581fa25045cea9585ae4e707585d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5319fd2dee9b4b47b98f59bca1572ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:38.522577 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-0127bd26-8c52-4eea-9624-3c997b837c04 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1efac6c215148ce8c3ecdce1e9a8742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d392a7d77f46fcb4faa017786796fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:38.544164 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-0127bd26-8c52-4eea-9624-3c997b837c04 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] 10.222.0.66 "GET /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d" status: 200 len: 1555 microversion: 2.1 time: 0.293673 Nov 22 12:22:38.545432 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 335/729] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:22:38 2021] GET /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d => generated 1555 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 12:22:38.557380 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-d1d37a3c-b9d5-4203-984f-85828a448514 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] 10.222.0.66 "GET /compute/v2.1/servers/8412ba15-56d4-416c-ade2-50b31de5ccb9" status: 200 len: 1512 microversion: 2.1 time: 0.384791 Nov 22 12:22:38.558205 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 395/730] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:22:38 2021] GET /compute/v2.1/servers/8412ba15-56d4-416c-ade2-50b31de5ccb9 => generated 1512 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:22:38.632175 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-ee455d59-24f6-475d-a152-982104315c2e tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:22:38.632689 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-ee455d59-24f6-475d-a152-982104315c2e tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] [instance: 82e102ee-4d06-4e2d-8ce4-2bf3a8d0a874] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:38.639113 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-ee455d59-24f6-475d-a152-982104315c2e tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:38.639599 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-ee455d59-24f6-475d-a152-982104315c2e tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:38.640380 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-ee455d59-24f6-475d-a152-982104315c2e tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:38.640805 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-ee455d59-24f6-475d-a152-982104315c2e tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:38.805287 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-ee455d59-24f6-475d-a152-982104315c2e tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc29a63c701941f9909e8235c80f5ce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc74b1d74b14a009699279eb128f9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:38.806135 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-f6066a02-e9d4-43ab-b142-c4255a8b7c05 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:22:38.807062 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-f6066a02-e9d4-43ab-b142-c4255a8b7c05 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] [instance: 10e112a7-d70a-4499-8be4-fd5e4ab3ec17] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:38.814973 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-ee455d59-24f6-475d-a152-982104315c2e tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] 10.222.0.66 "GET /compute/v2.1/servers/82e102ee-4d06-4e2d-8ce4-2bf3a8d0a874" status: 200 len: 1319 microversion: 2.1 time: 0.186701 Nov 22 12:22:38.815605 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 336/731] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:22:38 2021] GET /compute/v2.1/servers/82e102ee-4d06-4e2d-8ce4-2bf3a8d0a874 => generated 1319 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:22:38.825536 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-f6066a02-e9d4-43ab-b142-c4255a8b7c05 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:38.825536 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-f6066a02-e9d4-43ab-b142-c4255a8b7c05 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:38.825536 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-f6066a02-e9d4-43ab-b142-c4255a8b7c05 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:38.825536 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-f6066a02-e9d4-43ab-b142-c4255a8b7c05 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:38.826014 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-9567a790-45b8-44ac-9f20-68df58056642 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:22:38.826014 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-9567a790-45b8-44ac-9f20-68df58056642 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: 2306113c-8f98-42fd-8c0c-3dfac98fff21] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:38.829242 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-9567a790-45b8-44ac-9f20-68df58056642 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:38.829696 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-9567a790-45b8-44ac-9f20-68df58056642 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:38.830551 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-9567a790-45b8-44ac-9f20-68df58056642 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:38.831007 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-9567a790-45b8-44ac-9f20-68df58056642 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:38.951794 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-9567a790-45b8-44ac-9f20-68df58056642 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "POST /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21/action" status: 200 len: 38152 microversion: 2.1 time: 0.134682 Nov 22 12:22:38.955828 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 337/732] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Nov 22 12:22:38 2021] POST /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21/action => generated 38152 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 12:22:38.990938 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-f6066a02-e9d4-43ab-b142-c4255a8b7c05 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c15e2c2fa94be8b638f2257efb5820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575f4ae5262e4930b6658095a1aa8a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:39.000591 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-f6066a02-e9d4-43ab-b142-c4255a8b7c05 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] 10.222.0.66 "GET /compute/v2.1/servers/10e112a7-d70a-4499-8be4-fd5e4ab3ec17" status: 200 len: 1443 microversion: 2.1 time: 0.200290 Nov 22 12:22:39.001187 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 396/733] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:22:38 2021] GET /compute/v2.1/servers/10e112a7-d70a-4499-8be4-fd5e4ab3ec17 => generated 1443 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:22:39.018534 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-b8a75243-c125-4b97-8f1d-b2fde1db82e8 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:22:39.019270 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-b8a75243-c125-4b97-8f1d-b2fde1db82e8 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] [instance: 10e112a7-d70a-4499-8be4-fd5e4ab3ec17] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:39.027617 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-b8a75243-c125-4b97-8f1d-b2fde1db82e8 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:39.028406 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-b8a75243-c125-4b97-8f1d-b2fde1db82e8 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:39.029249 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-b8a75243-c125-4b97-8f1d-b2fde1db82e8 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:39.029694 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-b8a75243-c125-4b97-8f1d-b2fde1db82e8 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:39.180064 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-b8a75243-c125-4b97-8f1d-b2fde1db82e8 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c15e2c2fa94be8b638f2257efb5820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575f4ae5262e4930b6658095a1aa8a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:39.189198 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-b8a75243-c125-4b97-8f1d-b2fde1db82e8 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] 10.222.0.66 "GET /compute/v2.1/servers/10e112a7-d70a-4499-8be4-fd5e4ab3ec17" status: 200 len: 1443 microversion: 2.1 time: 0.174839 Nov 22 12:22:39.189826 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 338/734] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:22:39 2021] GET /compute/v2.1/servers/10e112a7-d70a-4499-8be4-fd5e4ab3ec17 => generated 1443 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:22:39.246507 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-3232b04f-0689-4a65-89ea-f35afe84cc3f tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:22:39.247718 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-3232b04f-0689-4a65-89ea-f35afe84cc3f tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: c9f6d441-246f-479e-8e88-ea701c0f87ff] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:39.259940 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-3232b04f-0689-4a65-89ea-f35afe84cc3f tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:39.260778 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-3232b04f-0689-4a65-89ea-f35afe84cc3f tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:39.262312 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-3232b04f-0689-4a65-89ea-f35afe84cc3f tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:39.263130 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-3232b04f-0689-4a65-89ea-f35afe84cc3f tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:39.448060 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-3232b04f-0689-4a65-89ea-f35afe84cc3f tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:39.457034 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-3232b04f-0689-4a65-89ea-f35afe84cc3f tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:39.458722 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-3232b04f-0689-4a65-89ea-f35afe84cc3f tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:39.460151 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-3232b04f-0689-4a65-89ea-f35afe84cc3f tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff" status: 200 len: 1722 microversion: 2.20 time: 0.224365 Nov 22 12:22:39.461036 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 397/735] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Nov 22 12:22:39 2021] GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff => generated 1722 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 12:22:39.566450 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-177ca0a7-82a7-441f-b18c-ec082df63d4d tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:22:39.567585 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-177ca0a7-82a7-441f-b18c-ec082df63d4d tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] [instance: 302ab8ef-5565-4f9b-9b91-b405d550a90d] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:39.578233 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-177ca0a7-82a7-441f-b18c-ec082df63d4d tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:39.579650 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-177ca0a7-82a7-441f-b18c-ec082df63d4d tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:39.581001 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-177ca0a7-82a7-441f-b18c-ec082df63d4d tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:39.581747 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-177ca0a7-82a7-441f-b18c-ec082df63d4d tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:39.585610 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-1727c309-f086-45bb-88cd-eb2a3c3bfaf1 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:22:39.586905 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-1727c309-f086-45bb-88cd-eb2a3c3bfaf1 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] [instance: 8412ba15-56d4-416c-ade2-50b31de5ccb9] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:39.600821 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-1727c309-f086-45bb-88cd-eb2a3c3bfaf1 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:39.601527 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-1727c309-f086-45bb-88cd-eb2a3c3bfaf1 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:39.602592 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-1727c309-f086-45bb-88cd-eb2a3c3bfaf1 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:39.604239 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-1727c309-f086-45bb-88cd-eb2a3c3bfaf1 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:39.947003 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-177ca0a7-82a7-441f-b18c-ec082df63d4d tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1efac6c215148ce8c3ecdce1e9a8742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d392a7d77f46fcb4faa017786796fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:39.948863 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-1727c309-f086-45bb-88cd-eb2a3c3bfaf1 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b581fa25045cea9585ae4e707585d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5319fd2dee9b4b47b98f59bca1572ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:39.961258 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-1727c309-f086-45bb-88cd-eb2a3c3bfaf1 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] 10.222.0.66 "GET /compute/v2.1/servers/8412ba15-56d4-416c-ade2-50b31de5ccb9" status: 200 len: 1512 microversion: 2.1 time: 0.384906 Nov 22 12:22:39.972501 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 398/736] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:22:39 2021] GET /compute/v2.1/servers/8412ba15-56d4-416c-ade2-50b31de5ccb9 => generated 1512 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:22:39.973340 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-177ca0a7-82a7-441f-b18c-ec082df63d4d tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] 10.222.0.66 "GET /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d" status: 200 len: 1555 microversion: 2.1 time: 0.413897 Nov 22 12:22:39.975101 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 339/737] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:22:39 2021] GET /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d => generated 1555 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:22:39.985201 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [req-42473488-cb2d-458b-8146-9c738a337135 req-c465353f-4a5b-42ed-ba3d-44203919b51a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82e102ee-4d06-4e2d-8ce4-2bf3a8d0a874", "name": "network-vif-plugged", "status": "completed", "tag": "278a21ab-1eb3-4777-ad07-2e2975db29ac"}]} {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:22:39.988064 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 12:22:39.988064 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: warnings.warn(msg) Nov 22 12:22:39.996215 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-87d653ee-6e3c-4368-a998-45f82f35ed5d tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:22:39.997361 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-87d653ee-6e3c-4368-a998-45f82f35ed5d tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] [instance: 82e102ee-4d06-4e2d-8ce4-2bf3a8d0a874] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:40.001554 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [req-42473488-cb2d-458b-8146-9c738a337135 req-c465353f-4a5b-42ed-ba3d-44203919b51a service nova] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:40.003040 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [req-42473488-cb2d-458b-8146-9c738a337135 req-c465353f-4a5b-42ed-ba3d-44203919b51a service nova] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:40.006090 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-87d653ee-6e3c-4368-a998-45f82f35ed5d tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:40.006787 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-87d653ee-6e3c-4368-a998-45f82f35ed5d tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:40.007859 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-87d653ee-6e3c-4368-a998-45f82f35ed5d tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:40.008567 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-87d653ee-6e3c-4368-a998-45f82f35ed5d tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:40.022254 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.compute.server_external_events [req-42473488-cb2d-458b-8146-9c738a337135 req-c465353f-4a5b-42ed-ba3d-44203919b51a service nova] Creating event network-vif-plugged:278a21ab-1eb3-4777-ad07-2e2975db29ac for instance 82e102ee-4d06-4e2d-8ce4-2bf3a8d0a874 on hv-cinder-76845 Nov 22 12:22:40.027988 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [req-42473488-cb2d-458b-8146-9c738a337135 req-c465353f-4a5b-42ed-ba3d-44203919b51a service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049468 Nov 22 12:22:40.029748 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 340/738] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Nov 22 12:22:39 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 12:22:40.040323 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-a703b6e3-2286-4549-a444-ab9111126f23 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:22:40.042533 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-a703b6e3-2286-4549-a444-ab9111126f23 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: 2306113c-8f98-42fd-8c0c-3dfac98fff21] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:40.052034 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-a703b6e3-2286-4549-a444-ab9111126f23 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:40.053168 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-a703b6e3-2286-4549-a444-ab9111126f23 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:40.054300 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-a703b6e3-2286-4549-a444-ab9111126f23 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:40.054780 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-a703b6e3-2286-4549-a444-ab9111126f23 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:40.230125 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-87d653ee-6e3c-4368-a998-45f82f35ed5d tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc29a63c701941f9909e8235c80f5ce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc74b1d74b14a009699279eb128f9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:40.246103 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-87d653ee-6e3c-4368-a998-45f82f35ed5d tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] 10.222.0.66 "GET /compute/v2.1/servers/82e102ee-4d06-4e2d-8ce4-2bf3a8d0a874" status: 200 len: 1319 microversion: 2.1 time: 0.259568 Nov 22 12:22:40.248126 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 399/739] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:22:39 2021] GET /compute/v2.1/servers/82e102ee-4d06-4e2d-8ce4-2bf3a8d0a874 => generated 1319 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:22:40.479177 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-685ee2f6-55b1-4725-bf97-4970b4410e37 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:22:40.479709 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-685ee2f6-55b1-4725-bf97-4970b4410e37 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: c9f6d441-246f-479e-8e88-ea701c0f87ff] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:40.493892 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-685ee2f6-55b1-4725-bf97-4970b4410e37 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:40.493892 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-685ee2f6-55b1-4725-bf97-4970b4410e37 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:40.493892 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-685ee2f6-55b1-4725-bf97-4970b4410e37 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:40.493892 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-685ee2f6-55b1-4725-bf97-4970b4410e37 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:40.876750 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-685ee2f6-55b1-4725-bf97-4970b4410e37 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:40.885665 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-685ee2f6-55b1-4725-bf97-4970b4410e37 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:40.887428 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-685ee2f6-55b1-4725-bf97-4970b4410e37 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:40.888774 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-685ee2f6-55b1-4725-bf97-4970b4410e37 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff" status: 200 len: 1665 microversion: 2.20 time: 0.413888 Nov 22 12:22:40.889348 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 400/740] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Nov 22 12:22:40 2021] GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff => generated 1665 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 22 12:22:40.908057 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-6a3764d2-674e-446c-9f03-c499ea51f317 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "db96e63f-64c8-4e78-8a77-3670f5400a39"}} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:22:40.909244 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-6a3764d2-674e-446c-9f03-c499ea51f317 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: c9f6d441-246f-479e-8e88-ea701c0f87ff] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:40.915656 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-6a3764d2-674e-446c-9f03-c499ea51f317 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:40.916101 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-6a3764d2-674e-446c-9f03-c499ea51f317 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:40.916894 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-6a3764d2-674e-446c-9f03-c499ea51f317 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:40.917322 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-6a3764d2-674e-446c-9f03-c499ea51f317 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:41.267484 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-6a3764d2-674e-446c-9f03-c499ea51f317 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "POST /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.363203 Nov 22 12:22:41.268184 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 401/741] 10.222.0.66 () {62 vars in 1363 bytes} [Mon Nov 22 12:22:40 2021] POST /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff/os-volume_attachments => generated 188 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 12:22:41.275977 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-941a447a-4488-4074-a821-b771e8747677 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:22:41.276911 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-941a447a-4488-4074-a821-b771e8747677 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] [instance: 8412ba15-56d4-416c-ade2-50b31de5ccb9] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:41.287562 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-941a447a-4488-4074-a821-b771e8747677 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:41.288265 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-941a447a-4488-4074-a821-b771e8747677 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:41.289899 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-941a447a-4488-4074-a821-b771e8747677 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:41.290239 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-941a447a-4488-4074-a821-b771e8747677 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:41.555278 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-941a447a-4488-4074-a821-b771e8747677 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b581fa25045cea9585ae4e707585d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5319fd2dee9b4b47b98f59bca1572ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:41.568771 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-941a447a-4488-4074-a821-b771e8747677 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] 10.222.0.66 "GET /compute/v2.1/servers/8412ba15-56d4-416c-ade2-50b31de5ccb9" status: 200 len: 1512 microversion: 2.1 time: 0.298195 Nov 22 12:22:41.569637 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 402/742] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:22:41 2021] GET /compute/v2.1/servers/8412ba15-56d4-416c-ade2-50b31de5ccb9 => generated 1512 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:22:41.586429 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-ae5a143c-fc49-4882-aff4-1b2462c4a527 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:22:41.587570 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-ae5a143c-fc49-4882-aff4-1b2462c4a527 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] [instance: 302ab8ef-5565-4f9b-9b91-b405d550a90d] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:41.598625 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-ae5a143c-fc49-4882-aff4-1b2462c4a527 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:41.599378 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-ae5a143c-fc49-4882-aff4-1b2462c4a527 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:41.600651 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-ae5a143c-fc49-4882-aff4-1b2462c4a527 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:41.601309 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-ae5a143c-fc49-4882-aff4-1b2462c4a527 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:41.908951 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-ae5a143c-fc49-4882-aff4-1b2462c4a527 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1efac6c215148ce8c3ecdce1e9a8742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d392a7d77f46fcb4faa017786796fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:41.919812 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-ae5a143c-fc49-4882-aff4-1b2462c4a527 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] 10.222.0.66 "GET /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d" status: 200 len: 1555 microversion: 2.1 time: 0.348699 Nov 22 12:22:41.920606 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 403/743] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:22:41 2021] GET /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d => generated 1555 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:22:41.926587 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-e6efbfcf-f471-494e-8e9a-5b907d5a8757 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:22:41.927767 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-e6efbfcf-f471-494e-8e9a-5b907d5a8757 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] [instance: 82e102ee-4d06-4e2d-8ce4-2bf3a8d0a874] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:41.936947 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-e6efbfcf-f471-494e-8e9a-5b907d5a8757 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:41.937551 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-e6efbfcf-f471-494e-8e9a-5b907d5a8757 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:41.938593 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-e6efbfcf-f471-494e-8e9a-5b907d5a8757 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:41.939299 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-e6efbfcf-f471-494e-8e9a-5b907d5a8757 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:42.184010 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-e6efbfcf-f471-494e-8e9a-5b907d5a8757 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc29a63c701941f9909e8235c80f5ce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc74b1d74b14a009699279eb128f9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:42.192422 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-e6efbfcf-f471-494e-8e9a-5b907d5a8757 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] 10.222.0.66 "GET /compute/v2.1/servers/82e102ee-4d06-4e2d-8ce4-2bf3a8d0a874" status: 200 len: 1319 microversion: 2.1 time: 0.270343 Nov 22 12:22:42.193135 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 404/744] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:22:41 2021] GET /compute/v2.1/servers/82e102ee-4d06-4e2d-8ce4-2bf3a8d0a874 => generated 1319 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:22:42.203496 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-13ef1fcc-ccd7-446f-98db-0984f49be8f5 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:22:42.203496 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-13ef1fcc-ccd7-446f-98db-0984f49be8f5 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: c9f6d441-246f-479e-8e88-ea701c0f87ff] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:42.206063 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-13ef1fcc-ccd7-446f-98db-0984f49be8f5 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:42.206517 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-13ef1fcc-ccd7-446f-98db-0984f49be8f5 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:42.207540 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-13ef1fcc-ccd7-446f-98db-0984f49be8f5 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:42.207997 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-13ef1fcc-ccd7-446f-98db-0984f49be8f5 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:42.362535 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-13ef1fcc-ccd7-446f-98db-0984f49be8f5 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "POST /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff/action" status: 202 len: 0 microversion: 2.20 time: 0.168041 Nov 22 12:22:42.366648 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 405/745] 10.222.0.66 () {62 vars in 1318 bytes} [Mon Nov 22 12:22:42 2021] POST /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff/action => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 22 12:22:42.372068 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [req-66700863-057c-482b-aa36-aecfd00f4fba req-e0e50300-7af9-4fb2-af76-6637394fce35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9f6d441-246f-479e-8e88-ea701c0f87ff", "name": "network-vif-unplugged", "status": "completed", "tag": "c3893e14-5c03-4b6a-b17d-c2dc56e8e688"}]} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:22:42.374099 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 12:22:42.374099 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: warnings.warn(msg) Nov 22 12:22:42.382350 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [req-66700863-057c-482b-aa36-aecfd00f4fba req-e0e50300-7af9-4fb2-af76-6637394fce35 service nova] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:42.382889 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [req-66700863-057c-482b-aa36-aecfd00f4fba req-e0e50300-7af9-4fb2-af76-6637394fce35 service nova] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:42.402625 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.compute.server_external_events [req-66700863-057c-482b-aa36-aecfd00f4fba req-e0e50300-7af9-4fb2-af76-6637394fce35 service nova] Unable to find a host for instance c9f6d441-246f-479e-8e88-ea701c0f87ff. Dropping event network-vif-unplugged {{(pid=116272) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Nov 22 12:22:42.403919 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [req-66700863-057c-482b-aa36-aecfd00f4fba req-e0e50300-7af9-4fb2-af76-6637394fce35 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.035808 Nov 22 12:22:42.404866 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 406/746] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Nov 22 12:22:42 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 38 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Nov 22 12:22:42.413268 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-cd4694c0-a446-4f76-a187-89791e3688f2 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:22:42.413890 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-cd4694c0-a446-4f76-a187-89791e3688f2 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: c9f6d441-246f-479e-8e88-ea701c0f87ff] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:42.420897 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-cd4694c0-a446-4f76-a187-89791e3688f2 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:42.425839 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-cd4694c0-a446-4f76-a187-89791e3688f2 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:42.426783 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-cd4694c0-a446-4f76-a187-89791e3688f2 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:42.427275 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-cd4694c0-a446-4f76-a187-89791e3688f2 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:42.607173 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-cd4694c0-a446-4f76-a187-89791e3688f2 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:42.617259 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-cd4694c0-a446-4f76-a187-89791e3688f2 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:42.618882 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-cd4694c0-a446-4f76-a187-89791e3688f2 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:42.620386 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-cd4694c0-a446-4f76-a187-89791e3688f2 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff" status: 200 len: 1751 microversion: 2.20 time: 0.211029 Nov 22 12:22:42.621833 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 407/747] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Nov 22 12:22:42 2021] GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff => generated 1751 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 12:22:42.626716 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [req-3d400e29-4784-49a0-8df8-6af65b4b4315 req-08219fb8-b317-4246-8ab5-cd0f50985873 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10e112a7-d70a-4499-8be4-fd5e4ab3ec17", "tag": "c27e22cf-346f-4a81-8e7d-d2418b4df811"}]} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:22:42.628271 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 12:22:42.628271 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: warnings.warn(msg) Nov 22 12:22:42.636315 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [req-3d400e29-4784-49a0-8df8-6af65b4b4315 req-08219fb8-b317-4246-8ab5-cd0f50985873 service nova] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:42.636315 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [req-3d400e29-4784-49a0-8df8-6af65b4b4315 req-08219fb8-b317-4246-8ab5-cd0f50985873 service nova] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:42.649912 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.compute.server_external_events [req-3d400e29-4784-49a0-8df8-6af65b4b4315 req-08219fb8-b317-4246-8ab5-cd0f50985873 service nova] Creating event network-changed:c27e22cf-346f-4a81-8e7d-d2418b4df811 for instance 10e112a7-d70a-4499-8be4-fd5e4ab3ec17 on hv-cinder-76845 Nov 22 12:22:42.656076 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [req-3d400e29-4784-49a0-8df8-6af65b4b4315 req-08219fb8-b317-4246-8ab5-cd0f50985873 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032829 Nov 22 12:22:42.656701 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 408/748] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Nov 22 12:22:42 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 12:22:42.662110 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-4ed0c90c-1ab6-47ec-bdb4-fd1a3385af75 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:22:42.662808 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-4ed0c90c-1ab6-47ec-bdb4-fd1a3385af75 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] [instance: 8412ba15-56d4-416c-ade2-50b31de5ccb9] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:42.670192 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-4ed0c90c-1ab6-47ec-bdb4-fd1a3385af75 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:42.670924 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-4ed0c90c-1ab6-47ec-bdb4-fd1a3385af75 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:42.671759 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-4ed0c90c-1ab6-47ec-bdb4-fd1a3385af75 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:42.672372 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-4ed0c90c-1ab6-47ec-bdb4-fd1a3385af75 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:42.847524 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-4ed0c90c-1ab6-47ec-bdb4-fd1a3385af75 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b581fa25045cea9585ae4e707585d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5319fd2dee9b4b47b98f59bca1572ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:42.856004 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-4ed0c90c-1ab6-47ec-bdb4-fd1a3385af75 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] 10.222.0.66 "GET /compute/v2.1/servers/8412ba15-56d4-416c-ade2-50b31de5ccb9" status: 200 len: 1512 microversion: 2.1 time: 0.197675 Nov 22 12:22:42.861632 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-a703b6e3-2286-4549-a444-ab9111126f23 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "POST /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21/action" status: 200 len: 38274 microversion: 2.1 time: 2.829020 Nov 22 12:22:42.875269 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 409/749] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:22:42 2021] GET /compute/v2.1/servers/8412ba15-56d4-416c-ade2-50b31de5ccb9 => generated 1512 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:22:42.875269 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-ae7ca751-99f0-4c4e-a1e9-93573eee1809 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:22:42.875269 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-ae7ca751-99f0-4c4e-a1e9-93573eee1809 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: 2306113c-8f98-42fd-8c0c-3dfac98fff21] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:42.876411 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 341/750] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Nov 22 12:22:40 2021] POST /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21/action => generated 38274 bytes in 2846 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 12:22:42.889141 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-ae7ca751-99f0-4c4e-a1e9-93573eee1809 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:42.889648 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-ae7ca751-99f0-4c4e-a1e9-93573eee1809 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:42.890498 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-ae7ca751-99f0-4c4e-a1e9-93573eee1809 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:42.890932 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-ae7ca751-99f0-4c4e-a1e9-93573eee1809 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:42.937606 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-ae7ca751-99f0-4c4e-a1e9-93573eee1809 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "GET /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21/ips" status: 200 len: 145 microversion: 2.1 time: 0.067128 Nov 22 12:22:42.945878 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 410/751] 10.222.0.66 () {58 vars in 1247 bytes} [Mon Nov 22 12:22:42 2021] GET /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21/ips => generated 145 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 12:22:42.967414 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-fc0371ec-bde5-4d13-9bdf-536e9d90731b tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:22:42.968624 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-fc0371ec-bde5-4d13-9bdf-536e9d90731b tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] [instance: 302ab8ef-5565-4f9b-9b91-b405d550a90d] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:42.984611 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-fc0371ec-bde5-4d13-9bdf-536e9d90731b tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:42.985056 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-fc0371ec-bde5-4d13-9bdf-536e9d90731b tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:42.985855 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-fc0371ec-bde5-4d13-9bdf-536e9d90731b tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:42.986285 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-fc0371ec-bde5-4d13-9bdf-536e9d90731b tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:43.218359 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-08644cba-7300-4d68-88aa-f91dfdc99365 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:22:43.219476 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-08644cba-7300-4d68-88aa-f91dfdc99365 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] [instance: 82e102ee-4d06-4e2d-8ce4-2bf3a8d0a874] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:43.229329 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-08644cba-7300-4d68-88aa-f91dfdc99365 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:43.230555 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-08644cba-7300-4d68-88aa-f91dfdc99365 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:43.231843 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-08644cba-7300-4d68-88aa-f91dfdc99365 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:43.234327 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-08644cba-7300-4d68-88aa-f91dfdc99365 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:43.455807 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-fc0371ec-bde5-4d13-9bdf-536e9d90731b tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1efac6c215148ce8c3ecdce1e9a8742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d392a7d77f46fcb4faa017786796fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:43.480170 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-fc0371ec-bde5-4d13-9bdf-536e9d90731b tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] 10.222.0.66 "GET /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d" status: 200 len: 1555 microversion: 2.1 time: 0.540044 Nov 22 12:22:43.497953 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 342/752] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:22:42 2021] GET /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d => generated 1555 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:22:43.632042 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-08644cba-7300-4d68-88aa-f91dfdc99365 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc29a63c701941f9909e8235c80f5ce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc74b1d74b14a009699279eb128f9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:43.648966 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-7c8cbebd-767a-403c-b254-b9ddff1b3a17 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:22:43.650287 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-7c8cbebd-767a-403c-b254-b9ddff1b3a17 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: c9f6d441-246f-479e-8e88-ea701c0f87ff] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:43.660074 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-08644cba-7300-4d68-88aa-f91dfdc99365 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] 10.222.0.66 "GET /compute/v2.1/servers/82e102ee-4d06-4e2d-8ce4-2bf3a8d0a874" status: 200 len: 1319 microversion: 2.1 time: 0.447460 Nov 22 12:22:43.664835 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-7c8cbebd-767a-403c-b254-b9ddff1b3a17 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:43.665850 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-7c8cbebd-767a-403c-b254-b9ddff1b3a17 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:43.667440 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-7c8cbebd-767a-403c-b254-b9ddff1b3a17 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:43.669233 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-7c8cbebd-767a-403c-b254-b9ddff1b3a17 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:43.672394 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 411/753] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:22:43 2021] GET /compute/v2.1/servers/82e102ee-4d06-4e2d-8ce4-2bf3a8d0a874 => generated 1319 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 12:22:43.887797 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-34bad883-3df9-4f00-8538-f5812db0c2c6 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:22:43.888416 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-34bad883-3df9-4f00-8538-f5812db0c2c6 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] [instance: 8412ba15-56d4-416c-ade2-50b31de5ccb9] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:43.898828 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-34bad883-3df9-4f00-8538-f5812db0c2c6 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:43.901045 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-34bad883-3df9-4f00-8538-f5812db0c2c6 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:43.902996 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-34bad883-3df9-4f00-8538-f5812db0c2c6 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:43.905370 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-34bad883-3df9-4f00-8538-f5812db0c2c6 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:44.057088 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-34bad883-3df9-4f00-8538-f5812db0c2c6 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b581fa25045cea9585ae4e707585d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5319fd2dee9b4b47b98f59bca1572ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:44.071469 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-34bad883-3df9-4f00-8538-f5812db0c2c6 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] 10.222.0.66 "GET /compute/v2.1/servers/8412ba15-56d4-416c-ade2-50b31de5ccb9" status: 200 len: 1470 microversion: 2.1 time: 0.188229 Nov 22 12:22:44.078736 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 412/754] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:22:43 2021] GET /compute/v2.1/servers/8412ba15-56d4-416c-ade2-50b31de5ccb9 => generated 1470 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:22:44.083749 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [req-6593e68c-44db-490e-a402-a3c0dfe1c1c4 req-5567a203-cecf-4f55-89ee-4346dc524a40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8412ba15-56d4-416c-ade2-50b31de5ccb9", "name": "network-vif-deleted", "tag": "0b5d6d5e-e442-4681-83aa-fb04b4fc7ce4"}]} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:22:44.090183 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 12:22:44.090183 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: warnings.warn(msg) Nov 22 12:22:44.106642 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [req-6593e68c-44db-490e-a402-a3c0dfe1c1c4 req-5567a203-cecf-4f55-89ee-4346dc524a40 service nova] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:44.107078 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [req-6593e68c-44db-490e-a402-a3c0dfe1c1c4 req-5567a203-cecf-4f55-89ee-4346dc524a40 service nova] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:44.153574 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.compute.server_external_events [req-6593e68c-44db-490e-a402-a3c0dfe1c1c4 req-5567a203-cecf-4f55-89ee-4346dc524a40 service nova] Creating event network-vif-deleted:0b5d6d5e-e442-4681-83aa-fb04b4fc7ce4 for instance 8412ba15-56d4-416c-ade2-50b31de5ccb9 on hv-cinder-76845 Nov 22 12:22:44.163330 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [req-6593e68c-44db-490e-a402-a3c0dfe1c1c4 req-5567a203-cecf-4f55-89ee-4346dc524a40 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081751 Nov 22 12:22:44.165808 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 413/755] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Nov 22 12:22:44 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 12:22:44.234637 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-7c8cbebd-767a-403c-b254-b9ddff1b3a17 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:44.252457 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-7c8cbebd-767a-403c-b254-b9ddff1b3a17 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:44.254104 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-7c8cbebd-767a-403c-b254-b9ddff1b3a17 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:44.255673 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-7c8cbebd-767a-403c-b254-b9ddff1b3a17 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff" status: 200 len: 1751 microversion: 2.20 time: 0.617424 Nov 22 12:22:44.270514 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 343/756] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Nov 22 12:22:43 2021] GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff => generated 1751 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 22 12:22:44.518610 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-cd47daa0-2b96-4919-b60e-6abba876eafa tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:22:44.518610 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-cd47daa0-2b96-4919-b60e-6abba876eafa tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] [instance: 302ab8ef-5565-4f9b-9b91-b405d550a90d] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:44.521848 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-cd47daa0-2b96-4919-b60e-6abba876eafa tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:44.522450 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-cd47daa0-2b96-4919-b60e-6abba876eafa tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:44.523336 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-cd47daa0-2b96-4919-b60e-6abba876eafa tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:44.523840 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-cd47daa0-2b96-4919-b60e-6abba876eafa tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:44.674819 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-cd47daa0-2b96-4919-b60e-6abba876eafa tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1efac6c215148ce8c3ecdce1e9a8742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d392a7d77f46fcb4faa017786796fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:44.677451 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-5d70d620-05d6-41ca-9f8b-b8e6b50aedba tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:22:44.678053 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-5d70d620-05d6-41ca-9f8b-b8e6b50aedba tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] [instance: 82e102ee-4d06-4e2d-8ce4-2bf3a8d0a874] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:44.683922 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-cd47daa0-2b96-4919-b60e-6abba876eafa tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] 10.222.0.66 "GET /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d" status: 200 len: 1561 microversion: 2.1 time: 0.176591 Nov 22 12:22:44.684106 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-5d70d620-05d6-41ca-9f8b-b8e6b50aedba tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:44.684494 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-5d70d620-05d6-41ca-9f8b-b8e6b50aedba tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:44.684610 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 414/757] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:22:44 2021] GET /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d => generated 1561 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:22:44.685213 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-5d70d620-05d6-41ca-9f8b-b8e6b50aedba tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:44.685722 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-5d70d620-05d6-41ca-9f8b-b8e6b50aedba tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:44.755002 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-1a9eaddf-5874-4b8b-a45d-402d7d39266e tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:22:44.755556 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-1a9eaddf-5874-4b8b-a45d-402d7d39266e tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] [instance: 302ab8ef-5565-4f9b-9b91-b405d550a90d] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:44.761822 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-1a9eaddf-5874-4b8b-a45d-402d7d39266e tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:44.762974 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-1a9eaddf-5874-4b8b-a45d-402d7d39266e tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:44.763399 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-1a9eaddf-5874-4b8b-a45d-402d7d39266e tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:44.763834 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-1a9eaddf-5874-4b8b-a45d-402d7d39266e tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:44.824239 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-5d70d620-05d6-41ca-9f8b-b8e6b50aedba tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc29a63c701941f9909e8235c80f5ce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc74b1d74b14a009699279eb128f9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:44.831781 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-5d70d620-05d6-41ca-9f8b-b8e6b50aedba tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] 10.222.0.66 "GET /compute/v2.1/servers/82e102ee-4d06-4e2d-8ce4-2bf3a8d0a874" status: 200 len: 1319 microversion: 2.1 time: 0.157908 Nov 22 12:22:44.832361 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 344/758] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:22:44 2021] GET /compute/v2.1/servers/82e102ee-4d06-4e2d-8ce4-2bf3a8d0a874 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 12:22:44.850223 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.objects.instance [None req-1a9eaddf-5874-4b8b-a45d-402d7d39266e tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lazy-loading 'services' on Instance uuid 302ab8ef-5565-4f9b-9b91-b405d550a90d {{(pid=116272) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 22 12:22:44.922007 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-1a9eaddf-5874-4b8b-a45d-402d7d39266e tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] 10.222.0.66 "DELETE /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d/os-volume_attachments/dd8e16c4-0006-4848-a35a-fcd0386356f1" status: 202 len: 0 microversion: 2.1 time: 0.171203 Nov 22 12:22:44.922620 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 415/759] 10.222.0.66 () {58 vars in 1415 bytes} [Mon Nov 22 12:22:44 2021] DELETE /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d/os-volume_attachments/dd8e16c4-0006-4848-a35a-fcd0386356f1 => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 22 12:22:44.930906 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-302807ff-5b79-461d-8988-35aa0eec33f9 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:22:44.931903 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-302807ff-5b79-461d-8988-35aa0eec33f9 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] [instance: 302ab8ef-5565-4f9b-9b91-b405d550a90d] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:44.938014 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-302807ff-5b79-461d-8988-35aa0eec33f9 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:44.938455 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-302807ff-5b79-461d-8988-35aa0eec33f9 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:44.939254 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-302807ff-5b79-461d-8988-35aa0eec33f9 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:44.939688 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-302807ff-5b79-461d-8988-35aa0eec33f9 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:44.969912 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-302807ff-5b79-461d-8988-35aa0eec33f9 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] 10.222.0.66 "GET /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042619 Nov 22 12:22:44.970475 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 345/760] 10.222.0.66 () {58 vars in 1301 bytes} [Mon Nov 22 12:22:44 2021] GET /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 12:22:45.095576 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-f2f8e502-ffac-41c4-b8c2-02f2bf3feddc tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:22:45.096261 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-f2f8e502-ffac-41c4-b8c2-02f2bf3feddc tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] [instance: 8412ba15-56d4-416c-ade2-50b31de5ccb9] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:45.103113 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-f2f8e502-ffac-41c4-b8c2-02f2bf3feddc tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:45.103584 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-f2f8e502-ffac-41c4-b8c2-02f2bf3feddc tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:45.104363 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-f2f8e502-ffac-41c4-b8c2-02f2bf3feddc tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:45.104791 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-f2f8e502-ffac-41c4-b8c2-02f2bf3feddc tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:45.137241 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-f2f8e502-ffac-41c4-b8c2-02f2bf3feddc tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:45.137683 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-f2f8e502-ffac-41c4-b8c2-02f2bf3feddc tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:45.138128 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.objects.instance [None req-f2f8e502-ffac-41c4-b8c2-02f2bf3feddc tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lazy-loading 'fault' on Instance uuid 8412ba15-56d4-416c-ade2-50b31de5ccb9 {{(pid=116272) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 22 12:22:45.180236 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-f2f8e502-ffac-41c4-b8c2-02f2bf3feddc tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b581fa25045cea9585ae4e707585d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5319fd2dee9b4b47b98f59bca1572ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:45.188725 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-f2f8e502-ffac-41c4-b8c2-02f2bf3feddc tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] 10.222.0.66 "GET /compute/v2.1/servers/8412ba15-56d4-416c-ade2-50b31de5ccb9" status: 200 len: 1307 microversion: 2.1 time: 0.097023 Nov 22 12:22:45.189355 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 416/761] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:22:45 2021] GET /compute/v2.1/servers/8412ba15-56d4-416c-ade2-50b31de5ccb9 => generated 1307 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:22:45.291644 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-dc72cb5a-ec01-428c-bd4e-333696342cf5 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:22:45.292907 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-dc72cb5a-ec01-428c-bd4e-333696342cf5 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: c9f6d441-246f-479e-8e88-ea701c0f87ff] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:45.300129 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-dc72cb5a-ec01-428c-bd4e-333696342cf5 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:45.300561 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-dc72cb5a-ec01-428c-bd4e-333696342cf5 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:45.301376 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-dc72cb5a-ec01-428c-bd4e-333696342cf5 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:45.301810 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-dc72cb5a-ec01-428c-bd4e-333696342cf5 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:45.449426 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-dc72cb5a-ec01-428c-bd4e-333696342cf5 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:45.459652 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-dc72cb5a-ec01-428c-bd4e-333696342cf5 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:45.461125 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-dc72cb5a-ec01-428c-bd4e-333696342cf5 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:45.462269 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-dc72cb5a-ec01-428c-bd4e-333696342cf5 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff" status: 200 len: 1753 microversion: 2.20 time: 0.176748 Nov 22 12:22:45.462848 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 346/762] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Nov 22 12:22:45 2021] GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff => generated 1753 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 12:22:45.849206 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-e9c59410-11a2-4b2c-abca-3f8d009482c7 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:22:45.849891 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-e9c59410-11a2-4b2c-abca-3f8d009482c7 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] [instance: 82e102ee-4d06-4e2d-8ce4-2bf3a8d0a874] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:45.857458 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-e9c59410-11a2-4b2c-abca-3f8d009482c7 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:45.857909 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-e9c59410-11a2-4b2c-abca-3f8d009482c7 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:45.858715 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-e9c59410-11a2-4b2c-abca-3f8d009482c7 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:45.859148 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-e9c59410-11a2-4b2c-abca-3f8d009482c7 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:45.985635 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-754dc9db-5369-43d6-827a-8886a332d3b8 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:22:45.987539 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-754dc9db-5369-43d6-827a-8886a332d3b8 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] [instance: 302ab8ef-5565-4f9b-9b91-b405d550a90d] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:45.997383 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-754dc9db-5369-43d6-827a-8886a332d3b8 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:45.998171 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-754dc9db-5369-43d6-827a-8886a332d3b8 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:46.000189 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-754dc9db-5369-43d6-827a-8886a332d3b8 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:46.000305 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-e9c59410-11a2-4b2c-abca-3f8d009482c7 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc29a63c701941f9909e8235c80f5ce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc74b1d74b14a009699279eb128f9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:46.000958 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-754dc9db-5369-43d6-827a-8886a332d3b8 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:46.008290 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-e9c59410-11a2-4b2c-abca-3f8d009482c7 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] 10.222.0.66 "GET /compute/v2.1/servers/82e102ee-4d06-4e2d-8ce4-2bf3a8d0a874" status: 200 len: 1319 microversion: 2.1 time: 0.162770 Nov 22 12:22:46.008900 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 417/763] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:22:45 2021] GET /compute/v2.1/servers/82e102ee-4d06-4e2d-8ce4-2bf3a8d0a874 => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:22:46.037805 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-754dc9db-5369-43d6-827a-8886a332d3b8 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] 10.222.0.66 "GET /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058658 Nov 22 12:22:46.037805 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 347/764] 10.222.0.66 () {58 vars in 1301 bytes} [Mon Nov 22 12:22:45 2021] GET /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 12:22:46.206324 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-cb2b4883-b96d-4a83-a6ab-8c6d6314c279 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:22:46.206936 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-cb2b4883-b96d-4a83-a6ab-8c6d6314c279 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] [instance: 8412ba15-56d4-416c-ade2-50b31de5ccb9] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:46.214487 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-cb2b4883-b96d-4a83-a6ab-8c6d6314c279 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:46.214973 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-cb2b4883-b96d-4a83-a6ab-8c6d6314c279 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:46.215820 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-cb2b4883-b96d-4a83-a6ab-8c6d6314c279 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:46.216337 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-cb2b4883-b96d-4a83-a6ab-8c6d6314c279 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:46.248662 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-cb2b4883-b96d-4a83-a6ab-8c6d6314c279 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:46.249109 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-cb2b4883-b96d-4a83-a6ab-8c6d6314c279 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:46.249564 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.objects.instance [None req-cb2b4883-b96d-4a83-a6ab-8c6d6314c279 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lazy-loading 'fault' on Instance uuid 8412ba15-56d4-416c-ade2-50b31de5ccb9 {{(pid=116272) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 22 12:22:46.291253 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-cb2b4883-b96d-4a83-a6ab-8c6d6314c279 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b581fa25045cea9585ae4e707585d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5319fd2dee9b4b47b98f59bca1572ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:46.298851 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-cb2b4883-b96d-4a83-a6ab-8c6d6314c279 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] 10.222.0.66 "GET /compute/v2.1/servers/8412ba15-56d4-416c-ade2-50b31de5ccb9" status: 200 len: 1307 microversion: 2.1 time: 0.096445 Nov 22 12:22:46.299453 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 418/765] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:22:46 2021] GET /compute/v2.1/servers/8412ba15-56d4-416c-ade2-50b31de5ccb9 => generated 1307 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:22:46.481400 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-fe9074e9-35eb-4322-b8ed-62ab27281818 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:22:46.481991 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-fe9074e9-35eb-4322-b8ed-62ab27281818 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: c9f6d441-246f-479e-8e88-ea701c0f87ff] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:46.488652 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-fe9074e9-35eb-4322-b8ed-62ab27281818 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:46.489100 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-fe9074e9-35eb-4322-b8ed-62ab27281818 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:46.489892 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-fe9074e9-35eb-4322-b8ed-62ab27281818 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:46.490299 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-fe9074e9-35eb-4322-b8ed-62ab27281818 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:46.663883 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-fe9074e9-35eb-4322-b8ed-62ab27281818 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:46.675022 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-fe9074e9-35eb-4322-b8ed-62ab27281818 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:46.676860 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-fe9074e9-35eb-4322-b8ed-62ab27281818 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:46.678161 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-fe9074e9-35eb-4322-b8ed-62ab27281818 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff" status: 200 len: 1753 microversion: 2.20 time: 0.200665 Nov 22 12:22:46.679074 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 348/766] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Nov 22 12:22:46 2021] GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff => generated 1753 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 12:22:47.026386 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-90f41b33-5796-476d-911c-8383ff253d9a tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:22:47.027162 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-90f41b33-5796-476d-911c-8383ff253d9a tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] [instance: 82e102ee-4d06-4e2d-8ce4-2bf3a8d0a874] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:47.035540 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-90f41b33-5796-476d-911c-8383ff253d9a tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:47.035981 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-90f41b33-5796-476d-911c-8383ff253d9a tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:47.036870 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-90f41b33-5796-476d-911c-8383ff253d9a tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:47.037317 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-90f41b33-5796-476d-911c-8383ff253d9a tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:47.050693 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-7bc207d7-0933-443d-b9fa-1e773d6d722a tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:22:47.051642 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-7bc207d7-0933-443d-b9fa-1e773d6d722a tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] [instance: 302ab8ef-5565-4f9b-9b91-b405d550a90d] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:47.059043 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-7bc207d7-0933-443d-b9fa-1e773d6d722a tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:47.059530 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-7bc207d7-0933-443d-b9fa-1e773d6d722a tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:47.060381 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-7bc207d7-0933-443d-b9fa-1e773d6d722a tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:47.060770 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-7bc207d7-0933-443d-b9fa-1e773d6d722a tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:47.094279 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-7bc207d7-0933-443d-b9fa-1e773d6d722a tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] 10.222.0.66 "GET /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048581 Nov 22 12:22:47.094867 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 349/767] 10.222.0.66 () {58 vars in 1301 bytes} [Mon Nov 22 12:22:47 2021] GET /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 12:22:47.187685 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-90f41b33-5796-476d-911c-8383ff253d9a tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc29a63c701941f9909e8235c80f5ce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc74b1d74b14a009699279eb128f9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:47.195025 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-90f41b33-5796-476d-911c-8383ff253d9a tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] 10.222.0.66 "GET /compute/v2.1/servers/82e102ee-4d06-4e2d-8ce4-2bf3a8d0a874" status: 200 len: 1319 microversion: 2.1 time: 0.172395 Nov 22 12:22:47.195691 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 419/768] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:22:47 2021] GET /compute/v2.1/servers/82e102ee-4d06-4e2d-8ce4-2bf3a8d0a874 => generated 1319 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:22:47.316311 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-67d3fe0e-8a76-46ad-88fd-2c8e0bcc7d9b tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:22:47.316947 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-67d3fe0e-8a76-46ad-88fd-2c8e0bcc7d9b tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] [instance: 8412ba15-56d4-416c-ade2-50b31de5ccb9] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:47.323851 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-67d3fe0e-8a76-46ad-88fd-2c8e0bcc7d9b tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:47.324319 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-67d3fe0e-8a76-46ad-88fd-2c8e0bcc7d9b tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:47.325140 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-67d3fe0e-8a76-46ad-88fd-2c8e0bcc7d9b tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:47.325556 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-67d3fe0e-8a76-46ad-88fd-2c8e0bcc7d9b tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:47.359946 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-67d3fe0e-8a76-46ad-88fd-2c8e0bcc7d9b tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:47.360442 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-67d3fe0e-8a76-46ad-88fd-2c8e0bcc7d9b tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:47.361050 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.objects.instance [None req-67d3fe0e-8a76-46ad-88fd-2c8e0bcc7d9b tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lazy-loading 'fault' on Instance uuid 8412ba15-56d4-416c-ade2-50b31de5ccb9 {{(pid=116273) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 22 12:22:47.406065 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-67d3fe0e-8a76-46ad-88fd-2c8e0bcc7d9b tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b581fa25045cea9585ae4e707585d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5319fd2dee9b4b47b98f59bca1572ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:47.414057 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-67d3fe0e-8a76-46ad-88fd-2c8e0bcc7d9b tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] 10.222.0.66 "GET /compute/v2.1/servers/8412ba15-56d4-416c-ade2-50b31de5ccb9" status: 200 len: 1307 microversion: 2.1 time: 0.101508 Nov 22 12:22:47.414626 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 350/769] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:22:47 2021] GET /compute/v2.1/servers/8412ba15-56d4-416c-ade2-50b31de5ccb9 => generated 1307 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:22:47.665450 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 22 12:22:47.666062 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: Mon Nov 22 12:22:47 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 22 12:22:47.700277 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-1e6d9151-a4f3-4940-bab6-1fcbc4b7c74d tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:22:47.701041 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-1e6d9151-a4f3-4940-bab6-1fcbc4b7c74d tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: c9f6d441-246f-479e-8e88-ea701c0f87ff] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:47.708021 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-1e6d9151-a4f3-4940-bab6-1fcbc4b7c74d tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:47.708584 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-1e6d9151-a4f3-4940-bab6-1fcbc4b7c74d tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:47.709487 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-1e6d9151-a4f3-4940-bab6-1fcbc4b7c74d tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:47.709995 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-1e6d9151-a4f3-4940-bab6-1fcbc4b7c74d tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:47.870237 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-1e6d9151-a4f3-4940-bab6-1fcbc4b7c74d tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:47.882223 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-1e6d9151-a4f3-4940-bab6-1fcbc4b7c74d tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:47.884174 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-1e6d9151-a4f3-4940-bab6-1fcbc4b7c74d tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:47.885607 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-1e6d9151-a4f3-4940-bab6-1fcbc4b7c74d tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff" status: 200 len: 1753 microversion: 2.20 time: 0.190647 Nov 22 12:22:47.886377 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 420/770] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Nov 22 12:22:47 2021] GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff => generated 1753 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 12:22:48.106452 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-90451642-c53f-4515-8fee-1aeaf5953447 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:22:48.107317 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-90451642-c53f-4515-8fee-1aeaf5953447 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] [instance: 302ab8ef-5565-4f9b-9b91-b405d550a90d] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:48.115015 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-90451642-c53f-4515-8fee-1aeaf5953447 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:48.115511 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-90451642-c53f-4515-8fee-1aeaf5953447 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:48.116858 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-90451642-c53f-4515-8fee-1aeaf5953447 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:48.116858 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-90451642-c53f-4515-8fee-1aeaf5953447 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:48.150668 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-90451642-c53f-4515-8fee-1aeaf5953447 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] 10.222.0.66 "GET /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047985 Nov 22 12:22:48.151343 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 351/771] 10.222.0.66 () {58 vars in 1301 bytes} [Mon Nov 22 12:22:48 2021] GET /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 12:22:48.212453 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-ad1be20a-f161-4be5-a299-e7c030a1628b tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:22:48.213131 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-ad1be20a-f161-4be5-a299-e7c030a1628b tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] [instance: 82e102ee-4d06-4e2d-8ce4-2bf3a8d0a874] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:48.221403 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-ad1be20a-f161-4be5-a299-e7c030a1628b tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:48.221937 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-ad1be20a-f161-4be5-a299-e7c030a1628b tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:48.222796 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-ad1be20a-f161-4be5-a299-e7c030a1628b tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:48.223248 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-ad1be20a-f161-4be5-a299-e7c030a1628b tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:48.362081 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-ad1be20a-f161-4be5-a299-e7c030a1628b tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc29a63c701941f9909e8235c80f5ce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc74b1d74b14a009699279eb128f9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:48.370342 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-ad1be20a-f161-4be5-a299-e7c030a1628b tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] 10.222.0.66 "GET /compute/v2.1/servers/82e102ee-4d06-4e2d-8ce4-2bf3a8d0a874" status: 200 len: 1508 microversion: 2.1 time: 0.161661 Nov 22 12:22:48.371618 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 421/772] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:22:48 2021] GET /compute/v2.1/servers/82e102ee-4d06-4e2d-8ce4-2bf3a8d0a874 => generated 1508 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:22:48.388215 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-2610486e-851a-44ac-ba3a-8d68aa839edf tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2f4b0d09-abee-4b75-b9af-72289f568b7b", "device": "/dev/sdb"}} {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:22:48.389234 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-2610486e-851a-44ac-ba3a-8d68aa839edf tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] [instance: 82e102ee-4d06-4e2d-8ce4-2bf3a8d0a874] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:48.397383 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-2610486e-851a-44ac-ba3a-8d68aa839edf tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:48.397830 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-2610486e-851a-44ac-ba3a-8d68aa839edf tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:48.398649 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-2610486e-851a-44ac-ba3a-8d68aa839edf tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:48.399047 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-2610486e-851a-44ac-ba3a-8d68aa839edf tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:48.429716 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-c0a58d21-ed5a-4bbb-9776-3064d756655b tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:22:48.430311 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-c0a58d21-ed5a-4bbb-9776-3064d756655b tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] [instance: 8412ba15-56d4-416c-ade2-50b31de5ccb9] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:48.437663 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-c0a58d21-ed5a-4bbb-9776-3064d756655b tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:48.438067 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-c0a58d21-ed5a-4bbb-9776-3064d756655b tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:48.438769 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-c0a58d21-ed5a-4bbb-9776-3064d756655b tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:48.439202 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-c0a58d21-ed5a-4bbb-9776-3064d756655b tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:48.454171 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.wsgi [None req-c0a58d21-ed5a-4bbb-9776-3064d756655b tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] HTTP exception thrown: Instance 8412ba15-56d4-416c-ade2-50b31de5ccb9 could not be found. Nov 22 12:22:48.454766 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-c0a58d21-ed5a-4bbb-9776-3064d756655b tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Returning 404 to user: Instance 8412ba15-56d4-416c-ade2-50b31de5ccb9 could not be found. {{(pid=116272) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 12:22:48.455781 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-c0a58d21-ed5a-4bbb-9776-3064d756655b tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] 10.222.0.66 "GET /compute/v2.1/servers/8412ba15-56d4-416c-ade2-50b31de5ccb9" status: 404 len: 111 microversion: 2.1 time: 0.029727 Nov 22 12:22:48.456509 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 422/773] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:22:48 2021] GET /compute/v2.1/servers/8412ba15-56d4-416c-ade2-50b31de5ccb9 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 22 12:22:48.701300 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-2610486e-851a-44ac-ba3a-8d68aa839edf tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] 10.222.0.66 "POST /compute/v2.1/servers/82e102ee-4d06-4e2d-8ce4-2bf3a8d0a874/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.316785 Nov 22 12:22:48.703265 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 352/774] 10.222.0.66 () {60 vars in 1322 bytes} [Mon Nov 22 12:22:48 2021] POST /compute/v2.1/servers/82e102ee-4d06-4e2d-8ce4-2bf3a8d0a874/os-volume_attachments => generated 194 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 12:22:48.737809 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-d5d1d735-0a41-4bd5-b2db-ee06c348e32c tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cb7a4721-8964-407a-8eb8-e7b93cdc0466"}} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:22:48.739072 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-d5d1d735-0a41-4bd5-b2db-ee06c348e32c tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: 2306113c-8f98-42fd-8c0c-3dfac98fff21] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:48.745961 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-d5d1d735-0a41-4bd5-b2db-ee06c348e32c tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:48.746545 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-d5d1d735-0a41-4bd5-b2db-ee06c348e32c tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:48.748419 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-d5d1d735-0a41-4bd5-b2db-ee06c348e32c tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:48.749645 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-d5d1d735-0a41-4bd5-b2db-ee06c348e32c tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:48.907409 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-627cbfaa-d921-4df3-ab39-62ac70d01875 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:22:48.908306 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-627cbfaa-d921-4df3-ab39-62ac70d01875 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: c9f6d441-246f-479e-8e88-ea701c0f87ff] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:48.917233 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-627cbfaa-d921-4df3-ab39-62ac70d01875 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:48.917679 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-627cbfaa-d921-4df3-ab39-62ac70d01875 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:48.918468 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-627cbfaa-d921-4df3-ab39-62ac70d01875 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:48.918902 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-627cbfaa-d921-4df3-ab39-62ac70d01875 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:49.058056 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-627cbfaa-d921-4df3-ab39-62ac70d01875 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:49.071114 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-627cbfaa-d921-4df3-ab39-62ac70d01875 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:49.073729 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-627cbfaa-d921-4df3-ab39-62ac70d01875 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:49.075277 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-627cbfaa-d921-4df3-ab39-62ac70d01875 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff" status: 200 len: 1809 microversion: 2.20 time: 0.174771 Nov 22 12:22:49.075857 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 353/775] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Nov 22 12:22:48 2021] GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff => generated 1809 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 22 12:22:49.166113 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-94f27ee6-e75f-48e8-ba9a-ab8ed1c9f358 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:22:49.167674 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-94f27ee6-e75f-48e8-ba9a-ab8ed1c9f358 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] [instance: 302ab8ef-5565-4f9b-9b91-b405d550a90d] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:49.174250 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-94f27ee6-e75f-48e8-ba9a-ab8ed1c9f358 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:49.174696 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-94f27ee6-e75f-48e8-ba9a-ab8ed1c9f358 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:49.175505 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-94f27ee6-e75f-48e8-ba9a-ab8ed1c9f358 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:49.175931 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-94f27ee6-e75f-48e8-ba9a-ab8ed1c9f358 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:49.205807 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-94f27ee6-e75f-48e8-ba9a-ab8ed1c9f358 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] 10.222.0.66 "GET /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045643 Nov 22 12:22:49.206412 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 354/776] 10.222.0.66 () {58 vars in 1301 bytes} [Mon Nov 22 12:22:49 2021] GET /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 12:22:50.094514 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-1ca24284-ba27-4eaa-a590-3bd9c1811c0d tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:22:50.095206 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-1ca24284-ba27-4eaa-a590-3bd9c1811c0d tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: c9f6d441-246f-479e-8e88-ea701c0f87ff] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:50.103029 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-1ca24284-ba27-4eaa-a590-3bd9c1811c0d tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:50.103029 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-1ca24284-ba27-4eaa-a590-3bd9c1811c0d tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:50.103752 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-1ca24284-ba27-4eaa-a590-3bd9c1811c0d tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:50.104187 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-1ca24284-ba27-4eaa-a590-3bd9c1811c0d tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:50.265819 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-1ca24284-ba27-4eaa-a590-3bd9c1811c0d tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:50.274743 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-1ca24284-ba27-4eaa-a590-3bd9c1811c0d tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:50.276245 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-1ca24284-ba27-4eaa-a590-3bd9c1811c0d tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:50.277534 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-1ca24284-ba27-4eaa-a590-3bd9c1811c0d tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff" status: 200 len: 1809 microversion: 2.20 time: 0.187165 Nov 22 12:22:50.278118 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 355/777] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Nov 22 12:22:50 2021] GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff => generated 1809 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 12:22:50.282865 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-7bff0638-7e47-4fcf-a99c-ad2cb1bad4d4 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:22:50.284369 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-7bff0638-7e47-4fcf-a99c-ad2cb1bad4d4 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] [instance: 302ab8ef-5565-4f9b-9b91-b405d550a90d] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:50.290722 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-7bff0638-7e47-4fcf-a99c-ad2cb1bad4d4 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:50.291169 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-7bff0638-7e47-4fcf-a99c-ad2cb1bad4d4 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:50.292022 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-7bff0638-7e47-4fcf-a99c-ad2cb1bad4d4 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:50.292767 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-7bff0638-7e47-4fcf-a99c-ad2cb1bad4d4 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:50.324353 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-7bff0638-7e47-4fcf-a99c-ad2cb1bad4d4 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] 10.222.0.66 "GET /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045174 Nov 22 12:22:50.324953 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 356/778] 10.222.0.66 () {58 vars in 1301 bytes} [Mon Nov 22 12:22:50 2021] GET /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 12:22:51.296470 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-fd1a2e43-845c-495e-8e43-6c28b453c422 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:22:51.297203 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-fd1a2e43-845c-495e-8e43-6c28b453c422 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: c9f6d441-246f-479e-8e88-ea701c0f87ff] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:51.303771 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-fd1a2e43-845c-495e-8e43-6c28b453c422 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:51.304214 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-fd1a2e43-845c-495e-8e43-6c28b453c422 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:51.304997 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-fd1a2e43-845c-495e-8e43-6c28b453c422 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:51.305435 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-fd1a2e43-845c-495e-8e43-6c28b453c422 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:51.451499 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-fd1a2e43-845c-495e-8e43-6c28b453c422 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:51.460750 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-fd1a2e43-845c-495e-8e43-6c28b453c422 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:51.462239 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-fd1a2e43-845c-495e-8e43-6c28b453c422 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:51.463419 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-fd1a2e43-845c-495e-8e43-6c28b453c422 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff" status: 200 len: 1809 microversion: 2.20 time: 0.171315 Nov 22 12:22:51.463963 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 357/779] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Nov 22 12:22:51 2021] GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff => generated 1809 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 12:22:51.468403 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-ba96d99a-bfab-40e8-b9bc-85f0febe5732 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:22:51.469277 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-ba96d99a-bfab-40e8-b9bc-85f0febe5732 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] [instance: 302ab8ef-5565-4f9b-9b91-b405d550a90d] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:51.475547 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-ba96d99a-bfab-40e8-b9bc-85f0febe5732 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:51.475977 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-ba96d99a-bfab-40e8-b9bc-85f0febe5732 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:51.476754 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-ba96d99a-bfab-40e8-b9bc-85f0febe5732 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:51.477182 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-ba96d99a-bfab-40e8-b9bc-85f0febe5732 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:51.507969 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-ba96d99a-bfab-40e8-b9bc-85f0febe5732 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] 10.222.0.66 "GET /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042928 Nov 22 12:22:51.508522 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 358/780] 10.222.0.66 () {58 vars in 1301 bytes} [Mon Nov 22 12:22:51 2021] GET /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 12:22:51.928510 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-d5d1d735-0a41-4bd5-b2db-ee06c348e32c tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "POST /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.193840 Nov 22 12:22:51.930054 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 423/781] 10.222.0.66 () {60 vars in 1322 bytes} [Mon Nov 22 12:22:48 2021] POST /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21/os-volume_attachments => generated 194 bytes in 3197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 12:22:52.483642 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-9b7d6350-99f0-4c83-81af-138db2313938 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:22:52.484259 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-9b7d6350-99f0-4c83-81af-138db2313938 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: c9f6d441-246f-479e-8e88-ea701c0f87ff] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:52.493209 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-9b7d6350-99f0-4c83-81af-138db2313938 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:52.493695 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-9b7d6350-99f0-4c83-81af-138db2313938 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:52.494520 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-9b7d6350-99f0-4c83-81af-138db2313938 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:52.495025 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-9b7d6350-99f0-4c83-81af-138db2313938 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:52.521560 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-79c3c1d2-96b8-48ea-ac3a-35a6fcc47d3a tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:22:52.522641 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-79c3c1d2-96b8-48ea-ac3a-35a6fcc47d3a tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] [instance: 302ab8ef-5565-4f9b-9b91-b405d550a90d] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:52.530701 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-79c3c1d2-96b8-48ea-ac3a-35a6fcc47d3a tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:52.531719 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-79c3c1d2-96b8-48ea-ac3a-35a6fcc47d3a tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:52.532329 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-79c3c1d2-96b8-48ea-ac3a-35a6fcc47d3a tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:52.532660 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-79c3c1d2-96b8-48ea-ac3a-35a6fcc47d3a tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:52.577216 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-79c3c1d2-96b8-48ea-ac3a-35a6fcc47d3a tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] 10.222.0.66 "GET /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.061090 Nov 22 12:22:52.578202 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 424/782] 10.222.0.66 () {58 vars in 1301 bytes} [Mon Nov 22 12:22:52 2021] GET /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d/os-volume_attachments => generated 25 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 22 12:22:52.676788 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-9b7d6350-99f0-4c83-81af-138db2313938 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:52.690187 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-9b7d6350-99f0-4c83-81af-138db2313938 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:52.692662 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-9b7d6350-99f0-4c83-81af-138db2313938 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:52.698165 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-9b7d6350-99f0-4c83-81af-138db2313938 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff" status: 200 len: 1809 microversion: 2.20 time: 0.216121 Nov 22 12:22:52.718293 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 359/783] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Nov 22 12:22:52 2021] GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff => generated 1809 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 12:22:52.813384 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-54e76a16-bf03-4346-8450-804ac471897b tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:22:52.813384 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-54e76a16-bf03-4346-8450-804ac471897b tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] [instance: 09a121f0-f7e5-4376-96bf-7008344dfe06] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:52.820430 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-54e76a16-bf03-4346-8450-804ac471897b tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:52.820884 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-54e76a16-bf03-4346-8450-804ac471897b tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:52.821615 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-54e76a16-bf03-4346-8450-804ac471897b tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:52.822042 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-54e76a16-bf03-4346-8450-804ac471897b tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:52.857217 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-54e76a16-bf03-4346-8450-804ac471897b tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] [instance: 09a121f0-f7e5-4376-96bf-7008344dfe06] Going to try to terminate instance {{(pid=116272) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 22 12:22:52.961472 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-54e76a16-bf03-4346-8450-804ac471897b tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] 10.222.0.66 "DELETE /compute/v2.1/servers/09a121f0-f7e5-4376-96bf-7008344dfe06" status: 204 len: 0 microversion: 2.1 time: 0.151711 Nov 22 12:22:52.962267 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 425/784] 10.222.0.66 () {58 vars in 1238 bytes} [Mon Nov 22 12:22:52 2021] DELETE /compute/v2.1/servers/09a121f0-f7e5-4376-96bf-7008344dfe06 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 22 12:22:52.972151 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-9351a60f-80fe-4ba7-b1da-bc683fececb6 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:22:52.972824 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-9351a60f-80fe-4ba7-b1da-bc683fececb6 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] [instance: 09a121f0-f7e5-4376-96bf-7008344dfe06] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:52.980259 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-9351a60f-80fe-4ba7-b1da-bc683fececb6 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:52.980970 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-9351a60f-80fe-4ba7-b1da-bc683fececb6 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:52.981981 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-9351a60f-80fe-4ba7-b1da-bc683fececb6 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:52.982553 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-9351a60f-80fe-4ba7-b1da-bc683fececb6 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:53.581441 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-9351a60f-80fe-4ba7-b1da-bc683fececb6 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b581fa25045cea9585ae4e707585d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5319fd2dee9b4b47b98f59bca1572ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:53.590612 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-9351a60f-80fe-4ba7-b1da-bc683fececb6 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] 10.222.0.66 "GET /compute/v2.1/servers/09a121f0-f7e5-4376-96bf-7008344dfe06" status: 200 len: 1514 microversion: 2.1 time: 0.623061 Nov 22 12:22:53.595999 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 360/785] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:22:52 2021] GET /compute/v2.1/servers/09a121f0-f7e5-4376-96bf-7008344dfe06 => generated 1514 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:22:53.732024 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-37115819-2760-4009-b6af-f8356703692c tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:22:53.732024 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-37115819-2760-4009-b6af-f8356703692c tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: c9f6d441-246f-479e-8e88-ea701c0f87ff] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:53.743645 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-37115819-2760-4009-b6af-f8356703692c tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:53.744020 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-37115819-2760-4009-b6af-f8356703692c tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:53.745071 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-37115819-2760-4009-b6af-f8356703692c tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:53.747870 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-37115819-2760-4009-b6af-f8356703692c tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:53.914722 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-37115819-2760-4009-b6af-f8356703692c tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:53.926114 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-37115819-2760-4009-b6af-f8356703692c tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:53.928494 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-37115819-2760-4009-b6af-f8356703692c tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:53.929881 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-37115819-2760-4009-b6af-f8356703692c tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff" status: 200 len: 1809 microversion: 2.20 time: 0.207982 Nov 22 12:22:53.942463 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 426/786] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Nov 22 12:22:53 2021] GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff => generated 1809 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 12:22:54.608542 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-041f7f95-c27f-44e4-9bee-725d85fd9e2e tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:22:54.609121 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-041f7f95-c27f-44e4-9bee-725d85fd9e2e tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] [instance: 09a121f0-f7e5-4376-96bf-7008344dfe06] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:54.616007 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-041f7f95-c27f-44e4-9bee-725d85fd9e2e tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:54.616650 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-041f7f95-c27f-44e4-9bee-725d85fd9e2e tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:54.617424 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-041f7f95-c27f-44e4-9bee-725d85fd9e2e tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:54.617875 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-041f7f95-c27f-44e4-9bee-725d85fd9e2e tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:54.772006 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-041f7f95-c27f-44e4-9bee-725d85fd9e2e tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b581fa25045cea9585ae4e707585d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5319fd2dee9b4b47b98f59bca1572ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:54.785151 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-041f7f95-c27f-44e4-9bee-725d85fd9e2e tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] 10.222.0.66 "GET /compute/v2.1/servers/09a121f0-f7e5-4376-96bf-7008344dfe06" status: 200 len: 1514 microversion: 2.1 time: 0.180819 Nov 22 12:22:54.786360 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 361/787] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:22:54 2021] GET /compute/v2.1/servers/09a121f0-f7e5-4376-96bf-7008344dfe06 => generated 1514 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:22:54.950000 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-e4866f9b-20fb-492e-9304-50c979f82ec7 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:22:54.950671 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-e4866f9b-20fb-492e-9304-50c979f82ec7 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: c9f6d441-246f-479e-8e88-ea701c0f87ff] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:54.958244 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-e4866f9b-20fb-492e-9304-50c979f82ec7 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:54.958801 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-e4866f9b-20fb-492e-9304-50c979f82ec7 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:54.960026 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-e4866f9b-20fb-492e-9304-50c979f82ec7 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:54.960598 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-e4866f9b-20fb-492e-9304-50c979f82ec7 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:55.013474 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-48c88899-25c8-46b1-9449-ee44b82a22af tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:22:55.014024 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-48c88899-25c8-46b1-9449-ee44b82a22af tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] [instance: 937d4958-6710-4c44-8451-2b659b87dc63] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:55.021133 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-48c88899-25c8-46b1-9449-ee44b82a22af tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:55.021511 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-48c88899-25c8-46b1-9449-ee44b82a22af tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:55.022411 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-48c88899-25c8-46b1-9449-ee44b82a22af tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:55.022867 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-48c88899-25c8-46b1-9449-ee44b82a22af tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:55.067924 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-48c88899-25c8-46b1-9449-ee44b82a22af tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] [instance: 937d4958-6710-4c44-8451-2b659b87dc63] Going to try to terminate instance {{(pid=116273) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 22 12:22:55.121148 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-e4866f9b-20fb-492e-9304-50c979f82ec7 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:55.132437 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-e4866f9b-20fb-492e-9304-50c979f82ec7 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:55.134733 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-e4866f9b-20fb-492e-9304-50c979f82ec7 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:55.136274 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-e4866f9b-20fb-492e-9304-50c979f82ec7 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff" status: 200 len: 1809 microversion: 2.20 time: 0.190140 Nov 22 12:22:55.137041 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 427/788] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Nov 22 12:22:54 2021] GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff => generated 1809 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 12:22:55.152592 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-48c88899-25c8-46b1-9449-ee44b82a22af tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] 10.222.0.66 "DELETE /compute/v2.1/servers/937d4958-6710-4c44-8451-2b659b87dc63" status: 204 len: 0 microversion: 2.1 time: 0.143455 Nov 22 12:22:55.153517 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 362/789] 10.222.0.66 () {58 vars in 1238 bytes} [Mon Nov 22 12:22:55 2021] DELETE /compute/v2.1/servers/937d4958-6710-4c44-8451-2b659b87dc63 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 22 12:22:55.161663 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-411046b2-1a0f-4042-9d0b-a44e60c60255 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:22:55.162408 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-411046b2-1a0f-4042-9d0b-a44e60c60255 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] [instance: 937d4958-6710-4c44-8451-2b659b87dc63] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:55.168871 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-411046b2-1a0f-4042-9d0b-a44e60c60255 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:55.169321 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-411046b2-1a0f-4042-9d0b-a44e60c60255 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:55.170127 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-411046b2-1a0f-4042-9d0b-a44e60c60255 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:55.170566 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-411046b2-1a0f-4042-9d0b-a44e60c60255 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:55.321119 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-411046b2-1a0f-4042-9d0b-a44e60c60255 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1efac6c215148ce8c3ecdce1e9a8742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d392a7d77f46fcb4faa017786796fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:55.329021 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-411046b2-1a0f-4042-9d0b-a44e60c60255 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] 10.222.0.66 "GET /compute/v2.1/servers/937d4958-6710-4c44-8451-2b659b87dc63" status: 200 len: 1506 microversion: 2.1 time: 0.171008 Nov 22 12:22:55.329613 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 428/790] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:22:55 2021] GET /compute/v2.1/servers/937d4958-6710-4c44-8451-2b659b87dc63 => generated 1506 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 12:22:55.802889 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-20f73d43-d723-4c17-b160-624038e66031 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:22:55.803696 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-20f73d43-d723-4c17-b160-624038e66031 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] [instance: 09a121f0-f7e5-4376-96bf-7008344dfe06] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:55.811263 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-20f73d43-d723-4c17-b160-624038e66031 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:55.811736 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-20f73d43-d723-4c17-b160-624038e66031 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:55.812522 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-20f73d43-d723-4c17-b160-624038e66031 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:55.812958 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-20f73d43-d723-4c17-b160-624038e66031 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:55.963558 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-20f73d43-d723-4c17-b160-624038e66031 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b581fa25045cea9585ae4e707585d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5319fd2dee9b4b47b98f59bca1572ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:55.974220 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-20f73d43-d723-4c17-b160-624038e66031 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] 10.222.0.66 "GET /compute/v2.1/servers/09a121f0-f7e5-4376-96bf-7008344dfe06" status: 200 len: 1514 microversion: 2.1 time: 0.175562 Nov 22 12:22:55.975574 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 363/791] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:22:55 2021] GET /compute/v2.1/servers/09a121f0-f7e5-4376-96bf-7008344dfe06 => generated 1514 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:22:56.156832 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-22780f08-9a82-415b-992b-6b1f5b6ccb5b tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:22:56.157533 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-22780f08-9a82-415b-992b-6b1f5b6ccb5b tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: c9f6d441-246f-479e-8e88-ea701c0f87ff] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:56.164879 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-22780f08-9a82-415b-992b-6b1f5b6ccb5b tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:56.165441 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-22780f08-9a82-415b-992b-6b1f5b6ccb5b tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:56.166274 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-22780f08-9a82-415b-992b-6b1f5b6ccb5b tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:56.166764 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-22780f08-9a82-415b-992b-6b1f5b6ccb5b tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:56.334443 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-22780f08-9a82-415b-992b-6b1f5b6ccb5b tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:56.345893 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-ac221e9a-3004-400d-999f-27e0beae2e6f tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:22:56.346614 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-22780f08-9a82-415b-992b-6b1f5b6ccb5b tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:56.347257 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-ac221e9a-3004-400d-999f-27e0beae2e6f tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] [instance: 937d4958-6710-4c44-8451-2b659b87dc63] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:56.348563 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-22780f08-9a82-415b-992b-6b1f5b6ccb5b tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:56.349813 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-22780f08-9a82-415b-992b-6b1f5b6ccb5b tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff" status: 200 len: 1809 microversion: 2.20 time: 0.198292 Nov 22 12:22:56.350608 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 429/792] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Nov 22 12:22:56 2021] GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff => generated 1809 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 12:22:56.358925 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-ac221e9a-3004-400d-999f-27e0beae2e6f tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:56.359576 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-ac221e9a-3004-400d-999f-27e0beae2e6f tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:56.360543 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-ac221e9a-3004-400d-999f-27e0beae2e6f tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:56.361076 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-ac221e9a-3004-400d-999f-27e0beae2e6f tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:56.515367 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-ac221e9a-3004-400d-999f-27e0beae2e6f tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1efac6c215148ce8c3ecdce1e9a8742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d392a7d77f46fcb4faa017786796fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:56.523153 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-ac221e9a-3004-400d-999f-27e0beae2e6f tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] 10.222.0.66 "GET /compute/v2.1/servers/937d4958-6710-4c44-8451-2b659b87dc63" status: 200 len: 1506 microversion: 2.1 time: 0.180959 Nov 22 12:22:56.523741 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 364/793] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:22:56 2021] GET /compute/v2.1/servers/937d4958-6710-4c44-8451-2b659b87dc63 => generated 1506 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 12:22:56.994352 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-5d36d612-44ba-4f8a-a825-5be1d47abfa9 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:22:56.995104 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-5d36d612-44ba-4f8a-a825-5be1d47abfa9 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] [instance: 09a121f0-f7e5-4376-96bf-7008344dfe06] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:57.002602 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-5d36d612-44ba-4f8a-a825-5be1d47abfa9 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:57.002892 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-5d36d612-44ba-4f8a-a825-5be1d47abfa9 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:57.003741 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-5d36d612-44ba-4f8a-a825-5be1d47abfa9 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:57.004183 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-5d36d612-44ba-4f8a-a825-5be1d47abfa9 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:57.167719 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-5d36d612-44ba-4f8a-a825-5be1d47abfa9 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b581fa25045cea9585ae4e707585d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5319fd2dee9b4b47b98f59bca1572ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:57.176226 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-5d36d612-44ba-4f8a-a825-5be1d47abfa9 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] 10.222.0.66 "GET /compute/v2.1/servers/09a121f0-f7e5-4376-96bf-7008344dfe06" status: 200 len: 1514 microversion: 2.1 time: 0.185832 Nov 22 12:22:57.177080 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 430/794] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:22:56 2021] GET /compute/v2.1/servers/09a121f0-f7e5-4376-96bf-7008344dfe06 => generated 1514 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 12:22:57.373271 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-6bf24ae6-4e88-4e9f-a590-02cf7ecffb4e tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:22:57.374046 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-6bf24ae6-4e88-4e9f-a590-02cf7ecffb4e tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: c9f6d441-246f-479e-8e88-ea701c0f87ff] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:57.381604 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-6bf24ae6-4e88-4e9f-a590-02cf7ecffb4e tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:57.382563 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-6bf24ae6-4e88-4e9f-a590-02cf7ecffb4e tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:57.383517 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-6bf24ae6-4e88-4e9f-a590-02cf7ecffb4e tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:57.384021 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-6bf24ae6-4e88-4e9f-a590-02cf7ecffb4e tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:57.540373 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-6bf24ae6-4e88-4e9f-a590-02cf7ecffb4e tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:57.541908 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-ce491aa6-23ad-4c3b-b099-18ace8da5941 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:22:57.542824 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-ce491aa6-23ad-4c3b-b099-18ace8da5941 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] [instance: 937d4958-6710-4c44-8451-2b659b87dc63] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:57.549405 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-ce491aa6-23ad-4c3b-b099-18ace8da5941 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:57.550070 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-ce491aa6-23ad-4c3b-b099-18ace8da5941 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:57.551041 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-ce491aa6-23ad-4c3b-b099-18ace8da5941 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:57.551655 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-ce491aa6-23ad-4c3b-b099-18ace8da5941 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:57.552854 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-6bf24ae6-4e88-4e9f-a590-02cf7ecffb4e tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:57.554420 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-6bf24ae6-4e88-4e9f-a590-02cf7ecffb4e tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:57.555699 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-6bf24ae6-4e88-4e9f-a590-02cf7ecffb4e tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff" status: 200 len: 1809 microversion: 2.20 time: 0.187596 Nov 22 12:22:57.556320 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 365/795] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Nov 22 12:22:57 2021] GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff => generated 1809 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 12:22:57.712241 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-ce491aa6-23ad-4c3b-b099-18ace8da5941 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1efac6c215148ce8c3ecdce1e9a8742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d392a7d77f46fcb4faa017786796fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:57.720425 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-ce491aa6-23ad-4c3b-b099-18ace8da5941 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] 10.222.0.66 "GET /compute/v2.1/servers/937d4958-6710-4c44-8451-2b659b87dc63" status: 200 len: 1506 microversion: 2.1 time: 0.183181 Nov 22 12:22:57.721000 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 431/796] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:22:57 2021] GET /compute/v2.1/servers/937d4958-6710-4c44-8451-2b659b87dc63 => generated 1506 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 12:22:58.193836 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-cabe439c-d3ec-4cf3-9451-07685b22a4a5 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:22:58.194763 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-cabe439c-d3ec-4cf3-9451-07685b22a4a5 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] [instance: 09a121f0-f7e5-4376-96bf-7008344dfe06] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:58.201230 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-cabe439c-d3ec-4cf3-9451-07685b22a4a5 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:58.201682 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-cabe439c-d3ec-4cf3-9451-07685b22a4a5 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:58.202493 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-cabe439c-d3ec-4cf3-9451-07685b22a4a5 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:58.202931 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-cabe439c-d3ec-4cf3-9451-07685b22a4a5 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:58.343375 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-cabe439c-d3ec-4cf3-9451-07685b22a4a5 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b581fa25045cea9585ae4e707585d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5319fd2dee9b4b47b98f59bca1572ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:58.350922 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-cabe439c-d3ec-4cf3-9451-07685b22a4a5 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] 10.222.0.66 "GET /compute/v2.1/servers/09a121f0-f7e5-4376-96bf-7008344dfe06" status: 200 len: 1514 microversion: 2.1 time: 0.160639 Nov 22 12:22:58.362219 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 366/797] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:22:58 2021] GET /compute/v2.1/servers/09a121f0-f7e5-4376-96bf-7008344dfe06 => generated 1514 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:22:58.574559 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-d99d5738-1492-4335-b5f3-a4914b81917c tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:22:58.575276 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-d99d5738-1492-4335-b5f3-a4914b81917c tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: c9f6d441-246f-479e-8e88-ea701c0f87ff] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:58.582122 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-d99d5738-1492-4335-b5f3-a4914b81917c tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:58.582719 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-d99d5738-1492-4335-b5f3-a4914b81917c tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:58.583671 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-d99d5738-1492-4335-b5f3-a4914b81917c tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:58.584396 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-d99d5738-1492-4335-b5f3-a4914b81917c tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:58.738225 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-4228c2a7-900f-4121-a45c-392b9cec8d30 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:22:58.739116 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-4228c2a7-900f-4121-a45c-392b9cec8d30 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] [instance: 937d4958-6710-4c44-8451-2b659b87dc63] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:58.749236 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-4228c2a7-900f-4121-a45c-392b9cec8d30 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:58.750635 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-4228c2a7-900f-4121-a45c-392b9cec8d30 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:58.751707 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-4228c2a7-900f-4121-a45c-392b9cec8d30 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:58.752352 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-4228c2a7-900f-4121-a45c-392b9cec8d30 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:58.812200 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-d99d5738-1492-4335-b5f3-a4914b81917c tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:58.825021 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-d99d5738-1492-4335-b5f3-a4914b81917c tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:58.826855 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-d99d5738-1492-4335-b5f3-a4914b81917c tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:58.828275 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-d99d5738-1492-4335-b5f3-a4914b81917c tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff" status: 200 len: 1809 microversion: 2.20 time: 0.258269 Nov 22 12:22:58.839354 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 432/798] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Nov 22 12:22:58 2021] GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff => generated 1809 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 12:22:58.937724 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-4228c2a7-900f-4121-a45c-392b9cec8d30 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1efac6c215148ce8c3ecdce1e9a8742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d392a7d77f46fcb4faa017786796fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:58.946009 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-4228c2a7-900f-4121-a45c-392b9cec8d30 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] 10.222.0.66 "GET /compute/v2.1/servers/937d4958-6710-4c44-8451-2b659b87dc63" status: 200 len: 1506 microversion: 2.1 time: 0.212173 Nov 22 12:22:58.956141 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 367/799] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:22:58 2021] GET /compute/v2.1/servers/937d4958-6710-4c44-8451-2b659b87dc63 => generated 1506 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 12:22:59.369365 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-98146256-154c-4706-b5fe-b31f9b9ef80c tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:22:59.370241 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-98146256-154c-4706-b5fe-b31f9b9ef80c tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] [instance: 09a121f0-f7e5-4376-96bf-7008344dfe06] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:59.377170 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-98146256-154c-4706-b5fe-b31f9b9ef80c tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:59.377611 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-98146256-154c-4706-b5fe-b31f9b9ef80c tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:59.378601 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-98146256-154c-4706-b5fe-b31f9b9ef80c tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:59.378996 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-98146256-154c-4706-b5fe-b31f9b9ef80c tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:59.562788 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-98146256-154c-4706-b5fe-b31f9b9ef80c tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b581fa25045cea9585ae4e707585d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5319fd2dee9b4b47b98f59bca1572ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:22:59.570778 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-98146256-154c-4706-b5fe-b31f9b9ef80c tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] 10.222.0.66 "GET /compute/v2.1/servers/09a121f0-f7e5-4376-96bf-7008344dfe06" status: 200 len: 1514 microversion: 2.1 time: 0.205164 Nov 22 12:22:59.571381 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 433/800] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:22:59 2021] GET /compute/v2.1/servers/09a121f0-f7e5-4376-96bf-7008344dfe06 => generated 1514 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:22:59.850650 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-9970e347-07ee-4c43-a843-b5a2575384b0 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:22:59.852085 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-9970e347-07ee-4c43-a843-b5a2575384b0 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: c9f6d441-246f-479e-8e88-ea701c0f87ff] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:59.867521 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-9970e347-07ee-4c43-a843-b5a2575384b0 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:59.869077 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-9970e347-07ee-4c43-a843-b5a2575384b0 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:59.872458 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-9970e347-07ee-4c43-a843-b5a2575384b0 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:59.873212 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-9970e347-07ee-4c43-a843-b5a2575384b0 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:59.963800 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-e90e2639-9c06-4d27-bf7f-8d603ad3b576 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:22:59.964586 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-e90e2639-9c06-4d27-bf7f-8d603ad3b576 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] [instance: 937d4958-6710-4c44-8451-2b659b87dc63] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:22:59.977890 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-e90e2639-9c06-4d27-bf7f-8d603ad3b576 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:59.978447 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-e90e2639-9c06-4d27-bf7f-8d603ad3b576 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:22:59.979408 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-e90e2639-9c06-4d27-bf7f-8d603ad3b576 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:22:59.984645 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-e90e2639-9c06-4d27-bf7f-8d603ad3b576 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:00.065340 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-9970e347-07ee-4c43-a843-b5a2575384b0 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:23:00.079213 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-9970e347-07ee-4c43-a843-b5a2575384b0 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:23:00.082053 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-9970e347-07ee-4c43-a843-b5a2575384b0 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:23:00.083341 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-9970e347-07ee-4c43-a843-b5a2575384b0 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff" status: 200 len: 1809 microversion: 2.20 time: 0.238727 Nov 22 12:23:00.083906 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 368/801] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Nov 22 12:22:59 2021] GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff => generated 1809 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 12:23:00.194101 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-e90e2639-9c06-4d27-bf7f-8d603ad3b576 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1efac6c215148ce8c3ecdce1e9a8742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d392a7d77f46fcb4faa017786796fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:23:00.201854 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-e90e2639-9c06-4d27-bf7f-8d603ad3b576 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] 10.222.0.66 "GET /compute/v2.1/servers/937d4958-6710-4c44-8451-2b659b87dc63" status: 200 len: 1506 microversion: 2.1 time: 0.242159 Nov 22 12:23:00.202432 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 434/802] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:22:59 2021] GET /compute/v2.1/servers/937d4958-6710-4c44-8451-2b659b87dc63 => generated 1506 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 12:23:00.590089 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-b3c300e8-7b64-4813-baab-6afe6f6d23a2 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:23:00.591564 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-b3c300e8-7b64-4813-baab-6afe6f6d23a2 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] [instance: 09a121f0-f7e5-4376-96bf-7008344dfe06] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:23:00.599402 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-b3c300e8-7b64-4813-baab-6afe6f6d23a2 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:00.600307 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-b3c300e8-7b64-4813-baab-6afe6f6d23a2 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:00.601285 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-b3c300e8-7b64-4813-baab-6afe6f6d23a2 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:00.601896 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-b3c300e8-7b64-4813-baab-6afe6f6d23a2 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:00.882278 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-b3c300e8-7b64-4813-baab-6afe6f6d23a2 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b581fa25045cea9585ae4e707585d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5319fd2dee9b4b47b98f59bca1572ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:23:00.892905 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-b3c300e8-7b64-4813-baab-6afe6f6d23a2 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] 10.222.0.66 "GET /compute/v2.1/servers/09a121f0-f7e5-4376-96bf-7008344dfe06" status: 200 len: 1514 microversion: 2.1 time: 0.307095 Nov 22 12:23:00.902096 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 369/803] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:23:00 2021] GET /compute/v2.1/servers/09a121f0-f7e5-4376-96bf-7008344dfe06 => generated 1514 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:23:01.103068 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-83443f75-107b-4972-ab09-ce76f0f09399 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:23:01.104515 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-83443f75-107b-4972-ab09-ce76f0f09399 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: c9f6d441-246f-479e-8e88-ea701c0f87ff] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:23:01.114430 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-83443f75-107b-4972-ab09-ce76f0f09399 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:01.116567 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-83443f75-107b-4972-ab09-ce76f0f09399 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:01.117448 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-83443f75-107b-4972-ab09-ce76f0f09399 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:01.117890 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-83443f75-107b-4972-ab09-ce76f0f09399 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:01.219910 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-7820ef39-b387-4110-904a-71f13dbfef7e tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:23:01.220503 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-7820ef39-b387-4110-904a-71f13dbfef7e tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] [instance: 937d4958-6710-4c44-8451-2b659b87dc63] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:23:01.232850 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-7820ef39-b387-4110-904a-71f13dbfef7e tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:01.233573 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-7820ef39-b387-4110-904a-71f13dbfef7e tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:01.235470 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-7820ef39-b387-4110-904a-71f13dbfef7e tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:01.236222 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-7820ef39-b387-4110-904a-71f13dbfef7e tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:01.570968 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-83443f75-107b-4972-ab09-ce76f0f09399 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:23:01.580002 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-83443f75-107b-4972-ab09-ce76f0f09399 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:23:01.581728 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-83443f75-107b-4972-ab09-ce76f0f09399 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:23:01.583191 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-83443f75-107b-4972-ab09-ce76f0f09399 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff" status: 200 len: 1809 microversion: 2.20 time: 0.483820 Nov 22 12:23:01.604899 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 435/804] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Nov 22 12:23:01 2021] GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff => generated 1809 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 12:23:01.611339 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-7820ef39-b387-4110-904a-71f13dbfef7e tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1efac6c215148ce8c3ecdce1e9a8742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d392a7d77f46fcb4faa017786796fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:23:01.622558 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-7820ef39-b387-4110-904a-71f13dbfef7e tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] 10.222.0.66 "GET /compute/v2.1/servers/937d4958-6710-4c44-8451-2b659b87dc63" status: 200 len: 1506 microversion: 2.1 time: 0.405572 Nov 22 12:23:01.624541 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 370/805] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:23:01 2021] GET /compute/v2.1/servers/937d4958-6710-4c44-8451-2b659b87dc63 => generated 1506 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:23:01.920138 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-7d380c16-4ffd-40b5-a3ae-53e03589027e tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:23:01.924530 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-7d380c16-4ffd-40b5-a3ae-53e03589027e tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] [instance: 09a121f0-f7e5-4376-96bf-7008344dfe06] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:23:01.931051 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-7d380c16-4ffd-40b5-a3ae-53e03589027e tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:01.931552 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-7d380c16-4ffd-40b5-a3ae-53e03589027e tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:01.932558 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-7d380c16-4ffd-40b5-a3ae-53e03589027e tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:01.932989 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-7d380c16-4ffd-40b5-a3ae-53e03589027e tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:02.189046 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-7d380c16-4ffd-40b5-a3ae-53e03589027e tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b581fa25045cea9585ae4e707585d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5319fd2dee9b4b47b98f59bca1572ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:23:02.199678 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-7d380c16-4ffd-40b5-a3ae-53e03589027e tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] 10.222.0.66 "GET /compute/v2.1/servers/09a121f0-f7e5-4376-96bf-7008344dfe06" status: 200 len: 1514 microversion: 2.1 time: 0.284351 Nov 22 12:23:02.200542 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 436/806] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:23:01 2021] GET /compute/v2.1/servers/09a121f0-f7e5-4376-96bf-7008344dfe06 => generated 1514 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:23:02.616074 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-2a837e26-72c8-4bb1-9be8-108cd68ec09a tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:23:02.617349 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-2a837e26-72c8-4bb1-9be8-108cd68ec09a tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: c9f6d441-246f-479e-8e88-ea701c0f87ff] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:23:02.624853 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-2a837e26-72c8-4bb1-9be8-108cd68ec09a tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:02.626756 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-2a837e26-72c8-4bb1-9be8-108cd68ec09a tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:02.628268 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-2a837e26-72c8-4bb1-9be8-108cd68ec09a tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:02.628875 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-2a837e26-72c8-4bb1-9be8-108cd68ec09a tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:02.641353 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-d05c39a3-0e59-4710-8ba3-c91e492cd7fd tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:23:02.642283 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-d05c39a3-0e59-4710-8ba3-c91e492cd7fd tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] [instance: 937d4958-6710-4c44-8451-2b659b87dc63] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:23:02.655406 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-d05c39a3-0e59-4710-8ba3-c91e492cd7fd tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:02.657870 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-d05c39a3-0e59-4710-8ba3-c91e492cd7fd tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:02.658902 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-d05c39a3-0e59-4710-8ba3-c91e492cd7fd tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:02.663859 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-d05c39a3-0e59-4710-8ba3-c91e492cd7fd tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:02.990902 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-2a837e26-72c8-4bb1-9be8-108cd68ec09a tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:23:03.000916 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-2a837e26-72c8-4bb1-9be8-108cd68ec09a tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:23:03.017580 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-2a837e26-72c8-4bb1-9be8-108cd68ec09a tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:23:03.026586 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-2a837e26-72c8-4bb1-9be8-108cd68ec09a tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff" status: 200 len: 1809 microversion: 2.20 time: 0.413600 Nov 22 12:23:03.037422 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 371/807] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Nov 22 12:23:02 2021] GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff => generated 1809 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 12:23:03.068652 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-d05c39a3-0e59-4710-8ba3-c91e492cd7fd tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1efac6c215148ce8c3ecdce1e9a8742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d392a7d77f46fcb4faa017786796fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:23:03.081792 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-d05c39a3-0e59-4710-8ba3-c91e492cd7fd tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] 10.222.0.66 "GET /compute/v2.1/servers/937d4958-6710-4c44-8451-2b659b87dc63" status: 200 len: 1506 microversion: 2.1 time: 0.444727 Nov 22 12:23:03.092063 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 437/808] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:23:02 2021] GET /compute/v2.1/servers/937d4958-6710-4c44-8451-2b659b87dc63 => generated 1506 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 12:23:03.228264 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-982a62eb-fd97-4e2e-bd5c-a1ef99abb642 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:23:03.228930 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-982a62eb-fd97-4e2e-bd5c-a1ef99abb642 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] [instance: 09a121f0-f7e5-4376-96bf-7008344dfe06] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:23:03.252547 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-982a62eb-fd97-4e2e-bd5c-a1ef99abb642 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:03.253272 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-982a62eb-fd97-4e2e-bd5c-a1ef99abb642 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:03.254251 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-982a62eb-fd97-4e2e-bd5c-a1ef99abb642 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:03.255545 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-982a62eb-fd97-4e2e-bd5c-a1ef99abb642 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:03.546357 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-982a62eb-fd97-4e2e-bd5c-a1ef99abb642 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b581fa25045cea9585ae4e707585d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5319fd2dee9b4b47b98f59bca1572ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:23:03.554435 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-982a62eb-fd97-4e2e-bd5c-a1ef99abb642 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] 10.222.0.66 "GET /compute/v2.1/servers/09a121f0-f7e5-4376-96bf-7008344dfe06" status: 200 len: 1514 microversion: 2.1 time: 0.340586 Nov 22 12:23:03.560051 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 372/809] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:23:03 2021] GET /compute/v2.1/servers/09a121f0-f7e5-4376-96bf-7008344dfe06 => generated 1514 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:23:04.058591 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-22fcd23b-d830-4c02-844d-632b60f871bc tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:23:04.059852 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-22fcd23b-d830-4c02-844d-632b60f871bc tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: c9f6d441-246f-479e-8e88-ea701c0f87ff] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:23:04.067202 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-22fcd23b-d830-4c02-844d-632b60f871bc tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:04.067804 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-22fcd23b-d830-4c02-844d-632b60f871bc tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:04.069177 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-22fcd23b-d830-4c02-844d-632b60f871bc tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:04.069696 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-22fcd23b-d830-4c02-844d-632b60f871bc tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:04.109771 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-45c0b803-e326-413d-aafd-9084a55ed75c tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:23:04.110954 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-45c0b803-e326-413d-aafd-9084a55ed75c tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] [instance: 937d4958-6710-4c44-8451-2b659b87dc63] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:23:04.137759 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-45c0b803-e326-413d-aafd-9084a55ed75c tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:04.138707 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-45c0b803-e326-413d-aafd-9084a55ed75c tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:04.139911 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-45c0b803-e326-413d-aafd-9084a55ed75c tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:04.140625 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-45c0b803-e326-413d-aafd-9084a55ed75c tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:04.325124 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-22fcd23b-d830-4c02-844d-632b60f871bc tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:23:04.339640 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-22fcd23b-d830-4c02-844d-632b60f871bc tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:23:04.341144 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-22fcd23b-d830-4c02-844d-632b60f871bc tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:23:04.342343 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-22fcd23b-d830-4c02-844d-632b60f871bc tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff" status: 200 len: 1809 microversion: 2.20 time: 0.296206 Nov 22 12:23:04.347564 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 438/810] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Nov 22 12:23:04 2021] GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff => generated 1809 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 12:23:04.427348 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-45c0b803-e326-413d-aafd-9084a55ed75c tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1efac6c215148ce8c3ecdce1e9a8742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d392a7d77f46fcb4faa017786796fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:23:04.436337 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-45c0b803-e326-413d-aafd-9084a55ed75c tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] 10.222.0.66 "GET /compute/v2.1/servers/937d4958-6710-4c44-8451-2b659b87dc63" status: 200 len: 1506 microversion: 2.1 time: 0.330847 Nov 22 12:23:04.446503 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 373/811] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:23:04 2021] GET /compute/v2.1/servers/937d4958-6710-4c44-8451-2b659b87dc63 => generated 1506 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:23:04.575118 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-cc728549-3b1c-4a84-8a98-905e0444b4c0 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:23:04.576590 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-cc728549-3b1c-4a84-8a98-905e0444b4c0 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] [instance: 09a121f0-f7e5-4376-96bf-7008344dfe06] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:23:04.597827 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-cc728549-3b1c-4a84-8a98-905e0444b4c0 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:04.598558 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-cc728549-3b1c-4a84-8a98-905e0444b4c0 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:04.601834 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-cc728549-3b1c-4a84-8a98-905e0444b4c0 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:04.602478 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-cc728549-3b1c-4a84-8a98-905e0444b4c0 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:04.822751 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-cc728549-3b1c-4a84-8a98-905e0444b4c0 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b581fa25045cea9585ae4e707585d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5319fd2dee9b4b47b98f59bca1572ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:23:04.831614 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-cc728549-3b1c-4a84-8a98-905e0444b4c0 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] 10.222.0.66 "GET /compute/v2.1/servers/09a121f0-f7e5-4376-96bf-7008344dfe06" status: 200 len: 1514 microversion: 2.1 time: 0.260275 Nov 22 12:23:04.832294 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 439/812] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:23:04 2021] GET /compute/v2.1/servers/09a121f0-f7e5-4376-96bf-7008344dfe06 => generated 1514 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:23:05.361041 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-3723a25c-5738-4500-a453-47f6b30934f9 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:23:05.361669 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-3723a25c-5738-4500-a453-47f6b30934f9 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: c9f6d441-246f-479e-8e88-ea701c0f87ff] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:23:05.375935 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-3723a25c-5738-4500-a453-47f6b30934f9 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:05.376811 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-3723a25c-5738-4500-a453-47f6b30934f9 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:05.382074 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-3723a25c-5738-4500-a453-47f6b30934f9 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:05.383176 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-3723a25c-5738-4500-a453-47f6b30934f9 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:05.460347 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-f8c4670c-5707-42ad-b36e-e2935077b187 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:23:05.466437 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-f8c4670c-5707-42ad-b36e-e2935077b187 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] [instance: 937d4958-6710-4c44-8451-2b659b87dc63] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:23:05.492512 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-f8c4670c-5707-42ad-b36e-e2935077b187 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:05.493252 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-f8c4670c-5707-42ad-b36e-e2935077b187 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:05.494365 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-f8c4670c-5707-42ad-b36e-e2935077b187 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:05.495059 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-f8c4670c-5707-42ad-b36e-e2935077b187 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:05.655998 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-3723a25c-5738-4500-a453-47f6b30934f9 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:23:05.669171 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-3723a25c-5738-4500-a453-47f6b30934f9 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:23:05.671186 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-3723a25c-5738-4500-a453-47f6b30934f9 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:23:05.672732 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-3723a25c-5738-4500-a453-47f6b30934f9 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff" status: 200 len: 1809 microversion: 2.20 time: 0.315615 Nov 22 12:23:05.673388 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 374/813] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Nov 22 12:23:05 2021] GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff => generated 1809 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 12:23:05.789076 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-f8c4670c-5707-42ad-b36e-e2935077b187 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1efac6c215148ce8c3ecdce1e9a8742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d392a7d77f46fcb4faa017786796fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:23:05.807473 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-f8c4670c-5707-42ad-b36e-e2935077b187 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] 10.222.0.66 "GET /compute/v2.1/servers/937d4958-6710-4c44-8451-2b659b87dc63" status: 200 len: 1506 microversion: 2.1 time: 0.358352 Nov 22 12:23:05.817662 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 440/814] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:23:05 2021] GET /compute/v2.1/servers/937d4958-6710-4c44-8451-2b659b87dc63 => generated 1506 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:23:05.848679 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-2c4775da-ba74-48ad-963c-7706c99db741 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:23:05.849579 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-2c4775da-ba74-48ad-963c-7706c99db741 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] [instance: 09a121f0-f7e5-4376-96bf-7008344dfe06] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:23:05.859648 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-2c4775da-ba74-48ad-963c-7706c99db741 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:05.860077 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-2c4775da-ba74-48ad-963c-7706c99db741 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:05.861423 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-2c4775da-ba74-48ad-963c-7706c99db741 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:05.862068 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-2c4775da-ba74-48ad-963c-7706c99db741 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:06.017007 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-2c4775da-ba74-48ad-963c-7706c99db741 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b581fa25045cea9585ae4e707585d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5319fd2dee9b4b47b98f59bca1572ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:23:06.024595 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-2c4775da-ba74-48ad-963c-7706c99db741 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] 10.222.0.66 "GET /compute/v2.1/servers/09a121f0-f7e5-4376-96bf-7008344dfe06" status: 200 len: 1514 microversion: 2.1 time: 0.179841 Nov 22 12:23:06.025160 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 375/815] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:23:05 2021] GET /compute/v2.1/servers/09a121f0-f7e5-4376-96bf-7008344dfe06 => generated 1514 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:23:06.690454 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-0407c910-74ad-4249-bf31-d480a6241246 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:23:06.691073 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-0407c910-74ad-4249-bf31-d480a6241246 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: c9f6d441-246f-479e-8e88-ea701c0f87ff] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:23:06.697946 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-0407c910-74ad-4249-bf31-d480a6241246 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:06.698688 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-0407c910-74ad-4249-bf31-d480a6241246 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:06.699728 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-0407c910-74ad-4249-bf31-d480a6241246 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:06.699958 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-0407c910-74ad-4249-bf31-d480a6241246 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:06.825534 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-837c84ff-454e-4b6b-9486-738d6554c5a5 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:23:06.827129 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-837c84ff-454e-4b6b-9486-738d6554c5a5 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] [instance: 937d4958-6710-4c44-8451-2b659b87dc63] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:23:06.834878 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-837c84ff-454e-4b6b-9486-738d6554c5a5 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:06.835362 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-837c84ff-454e-4b6b-9486-738d6554c5a5 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:06.836167 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-837c84ff-454e-4b6b-9486-738d6554c5a5 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:06.836954 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-837c84ff-454e-4b6b-9486-738d6554c5a5 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:06.872577 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-0407c910-74ad-4249-bf31-d480a6241246 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:23:06.882674 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-0407c910-74ad-4249-bf31-d480a6241246 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:23:06.887285 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-0407c910-74ad-4249-bf31-d480a6241246 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:23:06.890132 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-0407c910-74ad-4249-bf31-d480a6241246 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff" status: 200 len: 1809 microversion: 2.20 time: 0.203298 Nov 22 12:23:06.891449 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 441/816] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Nov 22 12:23:06 2021] GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff => generated 1809 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 12:23:07.020217 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-837c84ff-454e-4b6b-9486-738d6554c5a5 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1efac6c215148ce8c3ecdce1e9a8742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d392a7d77f46fcb4faa017786796fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:23:07.030967 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-837c84ff-454e-4b6b-9486-738d6554c5a5 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] 10.222.0.66 "GET /compute/v2.1/servers/937d4958-6710-4c44-8451-2b659b87dc63" status: 200 len: 1506 microversion: 2.1 time: 0.209236 Nov 22 12:23:07.031843 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 376/817] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:23:06 2021] GET /compute/v2.1/servers/937d4958-6710-4c44-8451-2b659b87dc63 => generated 1506 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:23:07.045126 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-bfc3f35c-4936-4de4-9983-99dfc2510df6 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:23:07.046316 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-bfc3f35c-4936-4de4-9983-99dfc2510df6 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] [instance: 09a121f0-f7e5-4376-96bf-7008344dfe06] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:23:07.053043 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-bfc3f35c-4936-4de4-9983-99dfc2510df6 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:07.053747 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-bfc3f35c-4936-4de4-9983-99dfc2510df6 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:07.055009 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-bfc3f35c-4936-4de4-9983-99dfc2510df6 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:07.055696 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-bfc3f35c-4936-4de4-9983-99dfc2510df6 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:07.222918 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-bfc3f35c-4936-4de4-9983-99dfc2510df6 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b581fa25045cea9585ae4e707585d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5319fd2dee9b4b47b98f59bca1572ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:23:07.231550 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-bfc3f35c-4936-4de4-9983-99dfc2510df6 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] 10.222.0.66 "GET /compute/v2.1/servers/09a121f0-f7e5-4376-96bf-7008344dfe06" status: 200 len: 1514 microversion: 2.1 time: 0.191294 Nov 22 12:23:07.232448 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 442/818] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:23:07 2021] GET /compute/v2.1/servers/09a121f0-f7e5-4376-96bf-7008344dfe06 => generated 1514 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:23:07.910094 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-89637213-1a97-4ca6-ae93-651cebba1e8e tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:23:07.910830 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-89637213-1a97-4ca6-ae93-651cebba1e8e tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: c9f6d441-246f-479e-8e88-ea701c0f87ff] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:23:07.925213 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-89637213-1a97-4ca6-ae93-651cebba1e8e tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:07.925710 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-89637213-1a97-4ca6-ae93-651cebba1e8e tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:07.926638 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-89637213-1a97-4ca6-ae93-651cebba1e8e tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:07.927327 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-89637213-1a97-4ca6-ae93-651cebba1e8e tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:08.053051 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-829eb747-9e3e-4bb5-8d41-9ccf3a2b4888 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:23:08.054277 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-829eb747-9e3e-4bb5-8d41-9ccf3a2b4888 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] [instance: 937d4958-6710-4c44-8451-2b659b87dc63] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:23:08.065897 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-829eb747-9e3e-4bb5-8d41-9ccf3a2b4888 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:08.066649 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-829eb747-9e3e-4bb5-8d41-9ccf3a2b4888 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:08.068511 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-829eb747-9e3e-4bb5-8d41-9ccf3a2b4888 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:08.069101 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-829eb747-9e3e-4bb5-8d41-9ccf3a2b4888 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:08.069978 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-89637213-1a97-4ca6-ae93-651cebba1e8e tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:23:08.079255 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-89637213-1a97-4ca6-ae93-651cebba1e8e tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:23:08.081121 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-89637213-1a97-4ca6-ae93-651cebba1e8e tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:23:08.082789 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-89637213-1a97-4ca6-ae93-651cebba1e8e tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff" status: 200 len: 1809 microversion: 2.20 time: 0.176318 Nov 22 12:23:08.083592 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 377/819] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Nov 22 12:23:07 2021] GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff => generated 1809 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 12:23:08.232359 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-829eb747-9e3e-4bb5-8d41-9ccf3a2b4888 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1efac6c215148ce8c3ecdce1e9a8742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d392a7d77f46fcb4faa017786796fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:23:08.242203 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-829eb747-9e3e-4bb5-8d41-9ccf3a2b4888 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] 10.222.0.66 "GET /compute/v2.1/servers/937d4958-6710-4c44-8451-2b659b87dc63" status: 200 len: 1506 microversion: 2.1 time: 0.195896 Nov 22 12:23:08.247324 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 443/820] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:23:08 2021] GET /compute/v2.1/servers/937d4958-6710-4c44-8451-2b659b87dc63 => generated 1506 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 12:23:08.250301 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-c6555658-f6cf-403f-99bb-fa8953bd38e6 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:23:08.251267 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-c6555658-f6cf-403f-99bb-fa8953bd38e6 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] [instance: 09a121f0-f7e5-4376-96bf-7008344dfe06] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:23:08.261956 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-c6555658-f6cf-403f-99bb-fa8953bd38e6 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:08.262403 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-c6555658-f6cf-403f-99bb-fa8953bd38e6 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:08.264423 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-c6555658-f6cf-403f-99bb-fa8953bd38e6 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:08.265608 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-c6555658-f6cf-403f-99bb-fa8953bd38e6 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:08.453293 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-c6555658-f6cf-403f-99bb-fa8953bd38e6 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b581fa25045cea9585ae4e707585d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5319fd2dee9b4b47b98f59bca1572ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:23:08.472000 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-c6555658-f6cf-403f-99bb-fa8953bd38e6 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] 10.222.0.66 "GET /compute/v2.1/servers/09a121f0-f7e5-4376-96bf-7008344dfe06" status: 200 len: 1514 microversion: 2.1 time: 0.225632 Nov 22 12:23:08.474874 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 378/821] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:23:08 2021] GET /compute/v2.1/servers/09a121f0-f7e5-4376-96bf-7008344dfe06 => generated 1514 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:23:09.108075 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-ad0ebb37-2754-4f3c-9c28-d99b47127ac6 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:23:09.109903 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-ad0ebb37-2754-4f3c-9c28-d99b47127ac6 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: c9f6d441-246f-479e-8e88-ea701c0f87ff] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:23:09.123493 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-ad0ebb37-2754-4f3c-9c28-d99b47127ac6 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:09.128949 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-ad0ebb37-2754-4f3c-9c28-d99b47127ac6 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:09.131606 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-ad0ebb37-2754-4f3c-9c28-d99b47127ac6 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:09.135555 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-ad0ebb37-2754-4f3c-9c28-d99b47127ac6 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:09.259499 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-d582fc27-bd03-4b8c-998d-b91352f3c61d tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:23:09.260497 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-d582fc27-bd03-4b8c-998d-b91352f3c61d tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] [instance: 937d4958-6710-4c44-8451-2b659b87dc63] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:23:09.273445 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-d582fc27-bd03-4b8c-998d-b91352f3c61d tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:09.273899 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-d582fc27-bd03-4b8c-998d-b91352f3c61d tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:09.274999 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-d582fc27-bd03-4b8c-998d-b91352f3c61d tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:09.275501 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-d582fc27-bd03-4b8c-998d-b91352f3c61d tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:09.804135 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-ad0ebb37-2754-4f3c-9c28-d99b47127ac6 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:23:09.819086 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-ad0ebb37-2754-4f3c-9c28-d99b47127ac6 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:23:09.820606 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-ad0ebb37-2754-4f3c-9c28-d99b47127ac6 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:23:09.821785 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-ad0ebb37-2754-4f3c-9c28-d99b47127ac6 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff" status: 200 len: 1809 microversion: 2.20 time: 0.718858 Nov 22 12:23:09.824076 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 444/822] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Nov 22 12:23:09 2021] GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff => generated 1809 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 12:23:09.835261 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-1969e478-72eb-45ac-9555-b8551a2baafe tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:23:09.836389 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-1969e478-72eb-45ac-9555-b8551a2baafe tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] [instance: 09a121f0-f7e5-4376-96bf-7008344dfe06] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:23:09.848520 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-1969e478-72eb-45ac-9555-b8551a2baafe tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:09.852801 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-1969e478-72eb-45ac-9555-b8551a2baafe tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:09.853925 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-1969e478-72eb-45ac-9555-b8551a2baafe tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:09.854685 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-1969e478-72eb-45ac-9555-b8551a2baafe tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:10.116184 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-d582fc27-bd03-4b8c-998d-b91352f3c61d tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1efac6c215148ce8c3ecdce1e9a8742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d392a7d77f46fcb4faa017786796fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:23:10.128026 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-d582fc27-bd03-4b8c-998d-b91352f3c61d tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] 10.222.0.66 "GET /compute/v2.1/servers/937d4958-6710-4c44-8451-2b659b87dc63" status: 200 len: 1506 microversion: 2.1 time: 0.872122 Nov 22 12:23:10.148377 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 379/823] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:23:09 2021] GET /compute/v2.1/servers/937d4958-6710-4c44-8451-2b659b87dc63 => generated 1506 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 12:23:10.183002 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [req-cf52fbdc-d67f-4a42-8e70-3e88fb0c3b82 req-a04b5231-bc20-44e7-9ce8-f4943a23afa7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09a121f0-f7e5-4376-96bf-7008344dfe06", "name": "network-vif-deleted", "tag": "c07cfd45-5b74-4945-9991-863824fb50f3"}]} {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:23:10.202558 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 12:23:10.202558 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: warnings.warn(msg) Nov 22 12:23:10.227804 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [req-cf52fbdc-d67f-4a42-8e70-3e88fb0c3b82 req-a04b5231-bc20-44e7-9ce8-f4943a23afa7 service nova] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:10.230082 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-1969e478-72eb-45ac-9555-b8551a2baafe tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b581fa25045cea9585ae4e707585d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5319fd2dee9b4b47b98f59bca1572ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:23:10.231099 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [req-cf52fbdc-d67f-4a42-8e70-3e88fb0c3b82 req-a04b5231-bc20-44e7-9ce8-f4943a23afa7 service nova] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:10.239074 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-1969e478-72eb-45ac-9555-b8551a2baafe tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] 10.222.0.66 "GET /compute/v2.1/servers/09a121f0-f7e5-4376-96bf-7008344dfe06" status: 200 len: 1514 microversion: 2.1 time: 0.413689 Nov 22 12:23:10.239994 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 445/824] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:23:09 2021] GET /compute/v2.1/servers/09a121f0-f7e5-4376-96bf-7008344dfe06 => generated 1514 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:23:10.262982 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.compute.server_external_events [req-cf52fbdc-d67f-4a42-8e70-3e88fb0c3b82 req-a04b5231-bc20-44e7-9ce8-f4943a23afa7 service nova] Creating event network-vif-deleted:c07cfd45-5b74-4945-9991-863824fb50f3 for instance 09a121f0-f7e5-4376-96bf-7008344dfe06 on hv-cinder-76845 Nov 22 12:23:10.282539 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [req-cf52fbdc-d67f-4a42-8e70-3e88fb0c3b82 req-a04b5231-bc20-44e7-9ce8-f4943a23afa7 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099729 Nov 22 12:23:10.283607 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 380/825] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Nov 22 12:23:10 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 12:23:10.842364 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-81d4a5a3-26b6-4318-a92e-8eb002a5fe5b tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:23:10.843419 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-81d4a5a3-26b6-4318-a92e-8eb002a5fe5b tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: c9f6d441-246f-479e-8e88-ea701c0f87ff] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:23:10.855152 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-81d4a5a3-26b6-4318-a92e-8eb002a5fe5b tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:10.857033 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-81d4a5a3-26b6-4318-a92e-8eb002a5fe5b tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:10.859304 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-81d4a5a3-26b6-4318-a92e-8eb002a5fe5b tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:10.860812 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-81d4a5a3-26b6-4318-a92e-8eb002a5fe5b tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:11.150490 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-b5cad958-3063-408b-9235-34500c76f4a7 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:23:11.151634 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-b5cad958-3063-408b-9235-34500c76f4a7 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] [instance: 937d4958-6710-4c44-8451-2b659b87dc63] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:23:11.175076 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-81d4a5a3-26b6-4318-a92e-8eb002a5fe5b tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:23:11.184377 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-81d4a5a3-26b6-4318-a92e-8eb002a5fe5b tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:23:11.185570 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-b5cad958-3063-408b-9235-34500c76f4a7 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:11.186103 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-b5cad958-3063-408b-9235-34500c76f4a7 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:11.186990 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-b5cad958-3063-408b-9235-34500c76f4a7 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:11.187430 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-b5cad958-3063-408b-9235-34500c76f4a7 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:11.194161 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-81d4a5a3-26b6-4318-a92e-8eb002a5fe5b tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:23:11.195508 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-81d4a5a3-26b6-4318-a92e-8eb002a5fe5b tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff" status: 200 len: 1809 microversion: 2.20 time: 0.357176 Nov 22 12:23:11.200060 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 446/826] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Nov 22 12:23:10 2021] GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff => generated 1809 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 12:23:11.257080 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-e9bfef0b-6f8f-4d29-91ae-83c024035f10 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:23:11.258633 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-e9bfef0b-6f8f-4d29-91ae-83c024035f10 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] [instance: 09a121f0-f7e5-4376-96bf-7008344dfe06] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:23:11.274117 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-e9bfef0b-6f8f-4d29-91ae-83c024035f10 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:11.274830 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-e9bfef0b-6f8f-4d29-91ae-83c024035f10 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:11.279356 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-e9bfef0b-6f8f-4d29-91ae-83c024035f10 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:11.280067 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-e9bfef0b-6f8f-4d29-91ae-83c024035f10 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:11.411389 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-e9bfef0b-6f8f-4d29-91ae-83c024035f10 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b581fa25045cea9585ae4e707585d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5319fd2dee9b4b47b98f59bca1572ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:23:11.424709 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-e9bfef0b-6f8f-4d29-91ae-83c024035f10 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] 10.222.0.66 "GET /compute/v2.1/servers/09a121f0-f7e5-4376-96bf-7008344dfe06" status: 200 len: 1472 microversion: 2.1 time: 0.171126 Nov 22 12:23:11.425521 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 447/827] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:23:11 2021] GET /compute/v2.1/servers/09a121f0-f7e5-4376-96bf-7008344dfe06 => generated 1472 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:23:11.490659 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-b5cad958-3063-408b-9235-34500c76f4a7 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1efac6c215148ce8c3ecdce1e9a8742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d392a7d77f46fcb4faa017786796fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:23:11.499081 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-b5cad958-3063-408b-9235-34500c76f4a7 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] 10.222.0.66 "GET /compute/v2.1/servers/937d4958-6710-4c44-8451-2b659b87dc63" status: 200 len: 1506 microversion: 2.1 time: 0.352819 Nov 22 12:23:11.512659 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 381/828] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:23:11 2021] GET /compute/v2.1/servers/937d4958-6710-4c44-8451-2b659b87dc63 => generated 1506 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 12:23:12.219706 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-0467a95b-cbd8-4a85-92a6-89ae88f21a6a tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:23:12.219921 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-0467a95b-cbd8-4a85-92a6-89ae88f21a6a tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: c9f6d441-246f-479e-8e88-ea701c0f87ff] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:23:12.233313 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-0467a95b-cbd8-4a85-92a6-89ae88f21a6a tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:12.233313 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-0467a95b-cbd8-4a85-92a6-89ae88f21a6a tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:12.233313 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-0467a95b-cbd8-4a85-92a6-89ae88f21a6a tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:12.233313 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-0467a95b-cbd8-4a85-92a6-89ae88f21a6a tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:12.390082 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-0467a95b-cbd8-4a85-92a6-89ae88f21a6a tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:23:12.405919 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-0467a95b-cbd8-4a85-92a6-89ae88f21a6a tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:23:12.406873 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-0467a95b-cbd8-4a85-92a6-89ae88f21a6a tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:23:12.408373 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-0467a95b-cbd8-4a85-92a6-89ae88f21a6a tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff" status: 200 len: 1809 microversion: 2.20 time: 0.192962 Nov 22 12:23:12.419679 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 448/829] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Nov 22 12:23:12 2021] GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff => generated 1809 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 22 12:23:12.442496 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-f5d3e65d-0aa8-4854-9f4c-cf353bbb79ef tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:23:12.446083 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-f5d3e65d-0aa8-4854-9f4c-cf353bbb79ef tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] [instance: 09a121f0-f7e5-4376-96bf-7008344dfe06] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:23:12.459690 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-f5d3e65d-0aa8-4854-9f4c-cf353bbb79ef tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:12.460385 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-f5d3e65d-0aa8-4854-9f4c-cf353bbb79ef tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:12.461472 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-f5d3e65d-0aa8-4854-9f4c-cf353bbb79ef tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:12.462384 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-f5d3e65d-0aa8-4854-9f4c-cf353bbb79ef tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:12.507588 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-f5d3e65d-0aa8-4854-9f4c-cf353bbb79ef tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:12.510643 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-f5d3e65d-0aa8-4854-9f4c-cf353bbb79ef tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:12.511582 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.objects.instance [None req-f5d3e65d-0aa8-4854-9f4c-cf353bbb79ef tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lazy-loading 'fault' on Instance uuid 09a121f0-f7e5-4376-96bf-7008344dfe06 {{(pid=116273) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 22 12:23:12.519455 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-ae966b6f-e605-4a41-96b6-e9ebfd127d18 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:23:12.520813 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-ae966b6f-e605-4a41-96b6-e9ebfd127d18 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] [instance: 937d4958-6710-4c44-8451-2b659b87dc63] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:23:12.555351 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-ae966b6f-e605-4a41-96b6-e9ebfd127d18 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:12.564804 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-ae966b6f-e605-4a41-96b6-e9ebfd127d18 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:12.566133 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-ae966b6f-e605-4a41-96b6-e9ebfd127d18 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:12.566867 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-ae966b6f-e605-4a41-96b6-e9ebfd127d18 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:12.624382 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-f5d3e65d-0aa8-4854-9f4c-cf353bbb79ef tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a4b581fa25045cea9585ae4e707585d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5319fd2dee9b4b47b98f59bca1572ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:23:12.635616 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-f5d3e65d-0aa8-4854-9f4c-cf353bbb79ef tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] 10.222.0.66 "GET /compute/v2.1/servers/09a121f0-f7e5-4376-96bf-7008344dfe06" status: 200 len: 1308 microversion: 2.1 time: 0.195065 Nov 22 12:23:12.647033 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 382/830] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:23:12 2021] GET /compute/v2.1/servers/09a121f0-f7e5-4376-96bf-7008344dfe06 => generated 1308 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:23:12.857225 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-ae966b6f-e605-4a41-96b6-e9ebfd127d18 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1efac6c215148ce8c3ecdce1e9a8742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d392a7d77f46fcb4faa017786796fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:23:12.867008 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-ae966b6f-e605-4a41-96b6-e9ebfd127d18 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] 10.222.0.66 "GET /compute/v2.1/servers/937d4958-6710-4c44-8451-2b659b87dc63" status: 200 len: 1506 microversion: 2.1 time: 0.352623 Nov 22 12:23:12.867617 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 449/831] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:23:12 2021] GET /compute/v2.1/servers/937d4958-6710-4c44-8451-2b659b87dc63 => generated 1506 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 12:23:13.382845 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [req-28d223a9-e484-42e1-aac6-f157f0049db3 req-f422bf01-c796-420e-bb22-ef3fd6ebf572 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "937d4958-6710-4c44-8451-2b659b87dc63", "name": "network-vif-deleted", "tag": "4c9b376a-8f72-407b-9a92-78116503f6ab"}]} {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:23:13.385195 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 12:23:13.385195 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: warnings.warn(msg) Nov 22 12:23:13.400255 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [req-28d223a9-e484-42e1-aac6-f157f0049db3 req-f422bf01-c796-420e-bb22-ef3fd6ebf572 service nova] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:13.403177 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [req-28d223a9-e484-42e1-aac6-f157f0049db3 req-f422bf01-c796-420e-bb22-ef3fd6ebf572 service nova] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:13.433520 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-595a1bb5-e5c2-4097-a830-c093a57ee1ad tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:23:13.435181 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-595a1bb5-e5c2-4097-a830-c093a57ee1ad tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: c9f6d441-246f-479e-8e88-ea701c0f87ff] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:23:13.442426 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.compute.server_external_events [req-28d223a9-e484-42e1-aac6-f157f0049db3 req-f422bf01-c796-420e-bb22-ef3fd6ebf572 service nova] Creating event network-vif-deleted:4c9b376a-8f72-407b-9a92-78116503f6ab for instance 937d4958-6710-4c44-8451-2b659b87dc63 on hv-cinder-76845 Nov 22 12:23:13.452316 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [req-28d223a9-e484-42e1-aac6-f157f0049db3 req-f422bf01-c796-420e-bb22-ef3fd6ebf572 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072340 Nov 22 12:23:13.453324 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 383/832] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Nov 22 12:23:13 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 12:23:13.476825 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-595a1bb5-e5c2-4097-a830-c093a57ee1ad tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:13.477281 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-595a1bb5-e5c2-4097-a830-c093a57ee1ad tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:13.478123 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-595a1bb5-e5c2-4097-a830-c093a57ee1ad tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:13.478618 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-595a1bb5-e5c2-4097-a830-c093a57ee1ad tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:13.653170 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-f5ae01b3-6897-4585-ad5b-907e59b6f0f4 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:23:13.655784 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-f5ae01b3-6897-4585-ad5b-907e59b6f0f4 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] [instance: 09a121f0-f7e5-4376-96bf-7008344dfe06] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:23:13.665229 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-f5ae01b3-6897-4585-ad5b-907e59b6f0f4 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:13.666258 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-f5ae01b3-6897-4585-ad5b-907e59b6f0f4 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:13.667285 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-f5ae01b3-6897-4585-ad5b-907e59b6f0f4 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:13.667707 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-f5ae01b3-6897-4585-ad5b-907e59b6f0f4 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:13.683087 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.wsgi [None req-f5ae01b3-6897-4585-ad5b-907e59b6f0f4 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] HTTP exception thrown: Instance 09a121f0-f7e5-4376-96bf-7008344dfe06 could not be found. Nov 22 12:23:13.683984 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-f5ae01b3-6897-4585-ad5b-907e59b6f0f4 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] Returning 404 to user: Instance 09a121f0-f7e5-4376-96bf-7008344dfe06 could not be found. {{(pid=116273) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 12:23:13.684983 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-f5ae01b3-6897-4585-ad5b-907e59b6f0f4 tempest-AttachVolumeNegativeTest-1969940156 tempest-AttachVolumeNegativeTest-1969940156-project] 10.222.0.66 "GET /compute/v2.1/servers/09a121f0-f7e5-4376-96bf-7008344dfe06" status: 404 len: 111 microversion: 2.1 time: 0.036046 Nov 22 12:23:13.689913 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 384/833] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:23:13 2021] GET /compute/v2.1/servers/09a121f0-f7e5-4376-96bf-7008344dfe06 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 22 12:23:13.704437 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-595a1bb5-e5c2-4097-a830-c093a57ee1ad tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:23:13.729918 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-595a1bb5-e5c2-4097-a830-c093a57ee1ad tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:23:13.733719 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-595a1bb5-e5c2-4097-a830-c093a57ee1ad tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:23:13.735528 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-595a1bb5-e5c2-4097-a830-c093a57ee1ad tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff" status: 200 len: 1809 microversion: 2.20 time: 0.310196 Nov 22 12:23:13.736503 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 450/834] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Nov 22 12:23:13 2021] GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff => generated 1809 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 12:23:13.884428 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-8903f2bc-9e37-413c-9173-7f445e7bddbc tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:23:13.885053 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-8903f2bc-9e37-413c-9173-7f445e7bddbc tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] [instance: 937d4958-6710-4c44-8451-2b659b87dc63] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:23:13.891132 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-8903f2bc-9e37-413c-9173-7f445e7bddbc tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:13.891594 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-8903f2bc-9e37-413c-9173-7f445e7bddbc tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:13.892446 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-8903f2bc-9e37-413c-9173-7f445e7bddbc tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:13.892874 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-8903f2bc-9e37-413c-9173-7f445e7bddbc tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:13.946632 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-8903f2bc-9e37-413c-9173-7f445e7bddbc tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:13.947420 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-8903f2bc-9e37-413c-9173-7f445e7bddbc tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:13.947927 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.objects.instance [None req-8903f2bc-9e37-413c-9173-7f445e7bddbc tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lazy-loading 'fault' on Instance uuid 937d4958-6710-4c44-8451-2b659b87dc63 {{(pid=116273) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 22 12:23:14.019545 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-8903f2bc-9e37-413c-9173-7f445e7bddbc tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1efac6c215148ce8c3ecdce1e9a8742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d392a7d77f46fcb4faa017786796fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:23:14.036176 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-8903f2bc-9e37-413c-9173-7f445e7bddbc tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] 10.222.0.66 "GET /compute/v2.1/servers/937d4958-6710-4c44-8451-2b659b87dc63" status: 200 len: 1311 microversion: 2.1 time: 0.155455 Nov 22 12:23:14.037146 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 385/835] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:23:13 2021] GET /compute/v2.1/servers/937d4958-6710-4c44-8451-2b659b87dc63 => generated 1311 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:23:14.757375 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-3ca3284d-23e2-4f68-9962-7157fc9917a8 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:23:14.758787 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-3ca3284d-23e2-4f68-9962-7157fc9917a8 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: c9f6d441-246f-479e-8e88-ea701c0f87ff] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:23:14.766614 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-3ca3284d-23e2-4f68-9962-7157fc9917a8 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:14.767362 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-3ca3284d-23e2-4f68-9962-7157fc9917a8 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:14.769056 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-3ca3284d-23e2-4f68-9962-7157fc9917a8 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:14.769660 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-3ca3284d-23e2-4f68-9962-7157fc9917a8 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:14.991332 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-3ca3284d-23e2-4f68-9962-7157fc9917a8 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:23:15.008740 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-3ca3284d-23e2-4f68-9962-7157fc9917a8 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:23:15.012546 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-3ca3284d-23e2-4f68-9962-7157fc9917a8 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:23:15.017533 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-3ca3284d-23e2-4f68-9962-7157fc9917a8 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff" status: 200 len: 1809 microversion: 2.20 time: 0.264492 Nov 22 12:23:15.031517 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 451/836] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Nov 22 12:23:14 2021] GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff => generated 1809 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 12:23:15.062266 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-ac455758-f552-4917-ab22-37789a30b737 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:23:15.063207 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-ac455758-f552-4917-ab22-37789a30b737 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] [instance: 937d4958-6710-4c44-8451-2b659b87dc63] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:23:15.076576 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-ac455758-f552-4917-ab22-37789a30b737 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:15.077034 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-ac455758-f552-4917-ab22-37789a30b737 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:15.081660 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-ac455758-f552-4917-ab22-37789a30b737 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:15.082112 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-ac455758-f552-4917-ab22-37789a30b737 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:15.140066 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-ac455758-f552-4917-ab22-37789a30b737 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:15.140856 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-ac455758-f552-4917-ab22-37789a30b737 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:15.141541 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.objects.instance [None req-ac455758-f552-4917-ab22-37789a30b737 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lazy-loading 'fault' on Instance uuid 937d4958-6710-4c44-8451-2b659b87dc63 {{(pid=116273) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 22 12:23:15.201149 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-ac455758-f552-4917-ab22-37789a30b737 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1efac6c215148ce8c3ecdce1e9a8742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d392a7d77f46fcb4faa017786796fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:23:15.217449 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-ac455758-f552-4917-ab22-37789a30b737 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] 10.222.0.66 "GET /compute/v2.1/servers/937d4958-6710-4c44-8451-2b659b87dc63" status: 200 len: 1311 microversion: 2.1 time: 0.162707 Nov 22 12:23:15.218535 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 386/837] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:23:15 2021] GET /compute/v2.1/servers/937d4958-6710-4c44-8451-2b659b87dc63 => generated 1311 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:23:16.038498 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-e0a4f7e2-8585-4ccd-95c7-f9c7430b586e tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:23:16.040868 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-e0a4f7e2-8585-4ccd-95c7-f9c7430b586e tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: c9f6d441-246f-479e-8e88-ea701c0f87ff] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:23:16.049156 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-e0a4f7e2-8585-4ccd-95c7-f9c7430b586e tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:16.049769 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-e0a4f7e2-8585-4ccd-95c7-f9c7430b586e tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:16.050813 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-e0a4f7e2-8585-4ccd-95c7-f9c7430b586e tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:16.051441 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-e0a4f7e2-8585-4ccd-95c7-f9c7430b586e tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:16.233786 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-cd275fbd-abb2-4c77-9f0c-dd829d0da465 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:23:16.237963 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-cd275fbd-abb2-4c77-9f0c-dd829d0da465 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] [instance: 937d4958-6710-4c44-8451-2b659b87dc63] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:23:16.246964 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-cd275fbd-abb2-4c77-9f0c-dd829d0da465 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:16.247748 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-cd275fbd-abb2-4c77-9f0c-dd829d0da465 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:16.248756 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-cd275fbd-abb2-4c77-9f0c-dd829d0da465 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:16.249340 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-cd275fbd-abb2-4c77-9f0c-dd829d0da465 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:16.297344 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-cd275fbd-abb2-4c77-9f0c-dd829d0da465 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:16.298050 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-cd275fbd-abb2-4c77-9f0c-dd829d0da465 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:16.298684 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.objects.instance [None req-cd275fbd-abb2-4c77-9f0c-dd829d0da465 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lazy-loading 'fault' on Instance uuid 937d4958-6710-4c44-8451-2b659b87dc63 {{(pid=116273) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 22 12:23:16.362745 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-cd275fbd-abb2-4c77-9f0c-dd829d0da465 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1efac6c215148ce8c3ecdce1e9a8742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d392a7d77f46fcb4faa017786796fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:23:16.377590 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-cd275fbd-abb2-4c77-9f0c-dd829d0da465 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] 10.222.0.66 "GET /compute/v2.1/servers/937d4958-6710-4c44-8451-2b659b87dc63" status: 200 len: 1311 microversion: 2.1 time: 0.147408 Nov 22 12:23:16.379074 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 387/838] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:23:16 2021] GET /compute/v2.1/servers/937d4958-6710-4c44-8451-2b659b87dc63 => generated 1311 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 12:23:16.387186 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-e0a4f7e2-8585-4ccd-95c7-f9c7430b586e tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:23:16.398030 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-e0a4f7e2-8585-4ccd-95c7-f9c7430b586e tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:23:16.401047 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-e0a4f7e2-8585-4ccd-95c7-f9c7430b586e tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:23:16.407580 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-e0a4f7e2-8585-4ccd-95c7-f9c7430b586e tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff" status: 200 len: 1809 microversion: 2.20 time: 0.370098 Nov 22 12:23:16.408862 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 452/839] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Nov 22 12:23:16 2021] GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff => generated 1809 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 12:23:17.394667 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-ff0679ad-14c5-4426-87d5-9e61beead73b tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:23:17.396157 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-ff0679ad-14c5-4426-87d5-9e61beead73b tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] [instance: 937d4958-6710-4c44-8451-2b659b87dc63] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:23:17.411045 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-ff0679ad-14c5-4426-87d5-9e61beead73b tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:17.412431 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-ff0679ad-14c5-4426-87d5-9e61beead73b tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:17.413583 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-ff0679ad-14c5-4426-87d5-9e61beead73b tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:17.414924 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-ff0679ad-14c5-4426-87d5-9e61beead73b tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:17.428090 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-1de444b6-fe8a-462f-a199-dd864dd728a8 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:23:17.430163 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-1de444b6-fe8a-462f-a199-dd864dd728a8 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: c9f6d441-246f-479e-8e88-ea701c0f87ff] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:23:17.458181 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-1de444b6-fe8a-462f-a199-dd864dd728a8 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:17.459262 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-1de444b6-fe8a-462f-a199-dd864dd728a8 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:17.468287 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-1de444b6-fe8a-462f-a199-dd864dd728a8 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:17.471819 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-1de444b6-fe8a-462f-a199-dd864dd728a8 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:17.478539 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-ff0679ad-14c5-4426-87d5-9e61beead73b tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:17.479621 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-ff0679ad-14c5-4426-87d5-9e61beead73b tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:17.480784 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.objects.instance [None req-ff0679ad-14c5-4426-87d5-9e61beead73b tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lazy-loading 'fault' on Instance uuid 937d4958-6710-4c44-8451-2b659b87dc63 {{(pid=116273) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 22 12:23:17.639519 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-ff0679ad-14c5-4426-87d5-9e61beead73b tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1efac6c215148ce8c3ecdce1e9a8742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d392a7d77f46fcb4faa017786796fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:23:17.648766 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-ff0679ad-14c5-4426-87d5-9e61beead73b tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] 10.222.0.66 "GET /compute/v2.1/servers/937d4958-6710-4c44-8451-2b659b87dc63" status: 200 len: 1311 microversion: 2.1 time: 0.258206 Nov 22 12:23:17.651734 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 388/840] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:23:17 2021] GET /compute/v2.1/servers/937d4958-6710-4c44-8451-2b659b87dc63 => generated 1311 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:23:17.933991 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-1de444b6-fe8a-462f-a199-dd864dd728a8 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:23:17.946969 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-1de444b6-fe8a-462f-a199-dd864dd728a8 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:23:17.955191 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-1de444b6-fe8a-462f-a199-dd864dd728a8 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:23:17.958623 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-1de444b6-fe8a-462f-a199-dd864dd728a8 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff" status: 200 len: 1809 microversion: 2.20 time: 0.535043 Nov 22 12:23:17.961711 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 453/841] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Nov 22 12:23:17 2021] GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff => generated 1809 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 12:23:18.224303 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-12cf03b9-910d-4fc8-add4-802f12da8d79 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:23:18.230374 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-12cf03b9-910d-4fc8-add4-802f12da8d79 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:18.230817 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-12cf03b9-910d-4fc8-add4-802f12da8d79 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:18.296118 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-12cf03b9-910d-4fc8-add4-802f12da8d79 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: 2306113c-8f98-42fd-8c0c-3dfac98fff21] Going to try to stop instance {{(pid=116273) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Nov 22 12:23:18.347983 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-12cf03b9-910d-4fc8-add4-802f12da8d79 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "POST /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21/action" status: 202 len: 0 microversion: 2.1 time: 0.126955 Nov 22 12:23:18.348578 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 389/842] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Nov 22 12:23:18 2021] POST /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21/action => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 22 12:23:18.357281 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-ff7231a1-9689-4504-be27-b6da5d5897eb tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:23:18.357932 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-ff7231a1-9689-4504-be27-b6da5d5897eb tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: 2306113c-8f98-42fd-8c0c-3dfac98fff21] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:23:18.364568 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-ff7231a1-9689-4504-be27-b6da5d5897eb tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:18.365383 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-ff7231a1-9689-4504-be27-b6da5d5897eb tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:18.379696 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-ff7231a1-9689-4504-be27-b6da5d5897eb tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:18.380669 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-ff7231a1-9689-4504-be27-b6da5d5897eb tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:18.588901 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-ff7231a1-9689-4504-be27-b6da5d5897eb tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41d885b9b854d8db11da5d325552301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f5dffe9bc3f41c7a2656d194fd02173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:23:18.598954 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-ff7231a1-9689-4504-be27-b6da5d5897eb tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "GET /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21" status: 200 len: 1723 microversion: 2.1 time: 0.244463 Nov 22 12:23:18.608251 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 454/843] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:23:18 2021] GET /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21 => generated 1723 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:23:18.669369 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-ebcf9883-bb14-49ba-ac14-80c494f75a7c tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:23:18.670777 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-ebcf9883-bb14-49ba-ac14-80c494f75a7c tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] [instance: 937d4958-6710-4c44-8451-2b659b87dc63] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:23:18.688176 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-ebcf9883-bb14-49ba-ac14-80c494f75a7c tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:18.688642 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-ebcf9883-bb14-49ba-ac14-80c494f75a7c tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:18.689803 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-ebcf9883-bb14-49ba-ac14-80c494f75a7c tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:18.690239 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-ebcf9883-bb14-49ba-ac14-80c494f75a7c tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:18.722108 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.wsgi [None req-ebcf9883-bb14-49ba-ac14-80c494f75a7c tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] HTTP exception thrown: Instance 937d4958-6710-4c44-8451-2b659b87dc63 could not be found. Nov 22 12:23:18.722707 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-ebcf9883-bb14-49ba-ac14-80c494f75a7c tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Returning 404 to user: Instance 937d4958-6710-4c44-8451-2b659b87dc63 could not be found. {{(pid=116273) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 12:23:18.723611 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-ebcf9883-bb14-49ba-ac14-80c494f75a7c tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] 10.222.0.66 "GET /compute/v2.1/servers/937d4958-6710-4c44-8451-2b659b87dc63" status: 404 len: 111 microversion: 2.1 time: 0.059042 Nov 22 12:23:18.724543 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 390/844] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:23:18 2021] GET /compute/v2.1/servers/937d4958-6710-4c44-8451-2b659b87dc63 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 22 12:23:18.732990 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-958d0c6e-a4a1-49e9-80d1-515eee8b700a tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:23:18.733805 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-958d0c6e-a4a1-49e9-80d1-515eee8b700a tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] [instance: 302ab8ef-5565-4f9b-9b91-b405d550a90d] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:23:18.740419 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-958d0c6e-a4a1-49e9-80d1-515eee8b700a tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:18.741188 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-958d0c6e-a4a1-49e9-80d1-515eee8b700a tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:18.742202 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-958d0c6e-a4a1-49e9-80d1-515eee8b700a tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:18.742856 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-958d0c6e-a4a1-49e9-80d1-515eee8b700a tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:18.769575 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-958d0c6e-a4a1-49e9-80d1-515eee8b700a tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] [instance: 302ab8ef-5565-4f9b-9b91-b405d550a90d] Going to try to terminate instance {{(pid=116272) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 22 12:23:18.921935 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-958d0c6e-a4a1-49e9-80d1-515eee8b700a tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] 10.222.0.66 "DELETE /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d" status: 204 len: 0 microversion: 2.1 time: 0.192031 Nov 22 12:23:18.923309 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 455/845] 10.222.0.66 () {58 vars in 1238 bytes} [Mon Nov 22 12:23:18 2021] DELETE /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d => generated 0 bytes in 194 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 22 12:23:18.937500 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-e03b5f60-f965-403c-8490-bb776ebddaeb tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:23:18.939583 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-e03b5f60-f965-403c-8490-bb776ebddaeb tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] [instance: 302ab8ef-5565-4f9b-9b91-b405d550a90d] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:23:18.956555 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-e03b5f60-f965-403c-8490-bb776ebddaeb tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:18.958112 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-e03b5f60-f965-403c-8490-bb776ebddaeb tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:18.960489 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-e03b5f60-f965-403c-8490-bb776ebddaeb tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:18.962602 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-e03b5f60-f965-403c-8490-bb776ebddaeb tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:18.983112 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-19553a7c-6c0d-4748-8819-44b468896098 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:23:18.984216 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-19553a7c-6c0d-4748-8819-44b468896098 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: c9f6d441-246f-479e-8e88-ea701c0f87ff] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:23:19.046351 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-19553a7c-6c0d-4748-8819-44b468896098 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:19.047278 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-19553a7c-6c0d-4748-8819-44b468896098 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:19.051884 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-19553a7c-6c0d-4748-8819-44b468896098 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:19.063967 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-19553a7c-6c0d-4748-8819-44b468896098 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:19.337693 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-e03b5f60-f965-403c-8490-bb776ebddaeb tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1efac6c215148ce8c3ecdce1e9a8742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d392a7d77f46fcb4faa017786796fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:23:19.348087 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-e03b5f60-f965-403c-8490-bb776ebddaeb tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] 10.222.0.66 "GET /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d" status: 200 len: 1521 microversion: 2.1 time: 0.418368 Nov 22 12:23:19.348676 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 391/846] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:23:18 2021] GET /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d => generated 1521 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:23:19.371998 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-19553a7c-6c0d-4748-8819-44b468896098 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:23:19.384137 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-19553a7c-6c0d-4748-8819-44b468896098 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:23:19.385780 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-19553a7c-6c0d-4748-8819-44b468896098 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:23:19.387716 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-19553a7c-6c0d-4748-8819-44b468896098 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff" status: 200 len: 1809 microversion: 2.20 time: 0.413089 Nov 22 12:23:19.388514 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 456/847] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Nov 22 12:23:18 2021] GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff => generated 1809 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 12:23:19.618291 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-16dbd28e-15d7-4a1e-8a5c-40b9a089ee5f tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:23:19.619597 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-16dbd28e-15d7-4a1e-8a5c-40b9a089ee5f tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: 2306113c-8f98-42fd-8c0c-3dfac98fff21] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:23:19.639002 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-16dbd28e-15d7-4a1e-8a5c-40b9a089ee5f tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:19.639510 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-16dbd28e-15d7-4a1e-8a5c-40b9a089ee5f tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:19.640773 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-16dbd28e-15d7-4a1e-8a5c-40b9a089ee5f tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:19.641216 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-16dbd28e-15d7-4a1e-8a5c-40b9a089ee5f tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:19.815654 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-16dbd28e-15d7-4a1e-8a5c-40b9a089ee5f tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41d885b9b854d8db11da5d325552301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f5dffe9bc3f41c7a2656d194fd02173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:23:19.826061 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-16dbd28e-15d7-4a1e-8a5c-40b9a089ee5f tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "GET /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21" status: 200 len: 1723 microversion: 2.1 time: 0.213951 Nov 22 12:23:19.836429 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 392/848] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:23:19 2021] GET /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21 => generated 1723 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:23:20.366002 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-8fe7ec1e-b7cd-489d-a9c9-73dc3e795596 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:23:20.366614 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-8fe7ec1e-b7cd-489d-a9c9-73dc3e795596 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] [instance: 302ab8ef-5565-4f9b-9b91-b405d550a90d] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:23:20.373639 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-8fe7ec1e-b7cd-489d-a9c9-73dc3e795596 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:20.374089 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-8fe7ec1e-b7cd-489d-a9c9-73dc3e795596 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:20.374896 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-8fe7ec1e-b7cd-489d-a9c9-73dc3e795596 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:20.375370 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-8fe7ec1e-b7cd-489d-a9c9-73dc3e795596 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:20.407323 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-c1892d13-b9a2-40dd-88d4-5a3cfa592c65 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:23:20.408238 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-c1892d13-b9a2-40dd-88d4-5a3cfa592c65 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: c9f6d441-246f-479e-8e88-ea701c0f87ff] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:23:20.421540 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-c1892d13-b9a2-40dd-88d4-5a3cfa592c65 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:20.422041 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-c1892d13-b9a2-40dd-88d4-5a3cfa592c65 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:20.422786 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-c1892d13-b9a2-40dd-88d4-5a3cfa592c65 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:20.423215 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-c1892d13-b9a2-40dd-88d4-5a3cfa592c65 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:20.573675 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-8fe7ec1e-b7cd-489d-a9c9-73dc3e795596 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1efac6c215148ce8c3ecdce1e9a8742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d392a7d77f46fcb4faa017786796fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:23:20.588796 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-8fe7ec1e-b7cd-489d-a9c9-73dc3e795596 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] 10.222.0.66 "GET /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d" status: 200 len: 1521 microversion: 2.1 time: 0.226527 Nov 22 12:23:20.589952 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 457/849] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:23:20 2021] GET /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d => generated 1521 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:23:20.658178 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-c1892d13-b9a2-40dd-88d4-5a3cfa592c65 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:23:20.673796 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-a2b4cdf4-04ee-412c-8f7c-56ebe7725da3 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:23:20.676893 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-c1892d13-b9a2-40dd-88d4-5a3cfa592c65 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:23:20.678098 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-a2b4cdf4-04ee-412c-8f7c-56ebe7725da3 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] [instance: 82e102ee-4d06-4e2d-8ce4-2bf3a8d0a874] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:23:20.679756 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-c1892d13-b9a2-40dd-88d4-5a3cfa592c65 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:23:20.683273 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-c1892d13-b9a2-40dd-88d4-5a3cfa592c65 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff" status: 200 len: 1809 microversion: 2.20 time: 0.280256 Nov 22 12:23:20.684866 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 393/850] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Nov 22 12:23:20 2021] GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff => generated 1809 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 22 12:23:20.705175 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-a2b4cdf4-04ee-412c-8f7c-56ebe7725da3 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:20.706445 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-a2b4cdf4-04ee-412c-8f7c-56ebe7725da3 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:20.708224 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-a2b4cdf4-04ee-412c-8f7c-56ebe7725da3 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:20.709079 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-a2b4cdf4-04ee-412c-8f7c-56ebe7725da3 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:20.849781 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-6873337c-f454-4974-b2de-9a13d1181309 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:23:20.852029 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-6873337c-f454-4974-b2de-9a13d1181309 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: 2306113c-8f98-42fd-8c0c-3dfac98fff21] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:23:20.863851 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-6873337c-f454-4974-b2de-9a13d1181309 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:20.864989 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-6873337c-f454-4974-b2de-9a13d1181309 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:20.866511 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-6873337c-f454-4974-b2de-9a13d1181309 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:20.867509 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-6873337c-f454-4974-b2de-9a13d1181309 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:20.968523 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.objects.instance [None req-a2b4cdf4-04ee-412c-8f7c-56ebe7725da3 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lazy-loading 'services' on Instance uuid 82e102ee-4d06-4e2d-8ce4-2bf3a8d0a874 {{(pid=116272) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 22 12:23:21.082881 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-a2b4cdf4-04ee-412c-8f7c-56ebe7725da3 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] 10.222.0.66 "DELETE /compute/v2.1/servers/82e102ee-4d06-4e2d-8ce4-2bf3a8d0a874/os-volume_attachments/2f4b0d09-abee-4b75-b9af-72289f568b7b" status: 202 len: 0 microversion: 2.1 time: 0.414781 Nov 22 12:23:21.088237 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 458/851] 10.222.0.66 () {58 vars in 1415 bytes} [Mon Nov 22 12:23:20 2021] DELETE /compute/v2.1/servers/82e102ee-4d06-4e2d-8ce4-2bf3a8d0a874/os-volume_attachments/2f4b0d09-abee-4b75-b9af-72289f568b7b => generated 0 bytes in 421 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 22 12:23:21.111150 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-6873337c-f454-4974-b2de-9a13d1181309 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41d885b9b854d8db11da5d325552301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f5dffe9bc3f41c7a2656d194fd02173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:23:21.112318 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [req-c16666ad-c1f5-4ca1-b45b-94f2c8c2b2b0 req-d4dcacee-ee3b-427e-a27f-315def429974 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9f6d441-246f-479e-8e88-ea701c0f87ff", "name": "network-vif-plugged", "status": "completed", "tag": "c3893e14-5c03-4b6a-b17d-c2dc56e8e688"}]} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:23:21.114270 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 12:23:21.114270 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: warnings.warn(msg) Nov 22 12:23:21.131405 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [req-c16666ad-c1f5-4ca1-b45b-94f2c8c2b2b0 req-d4dcacee-ee3b-427e-a27f-315def429974 service nova] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:21.131884 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [req-c16666ad-c1f5-4ca1-b45b-94f2c8c2b2b0 req-d4dcacee-ee3b-427e-a27f-315def429974 service nova] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:21.145197 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-6873337c-f454-4974-b2de-9a13d1181309 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "GET /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21" status: 200 len: 1723 microversion: 2.1 time: 0.303753 Nov 22 12:23:21.148455 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 394/852] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:23:20 2021] GET /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21 => generated 1723 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 12:23:21.171736 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.compute.server_external_events [req-c16666ad-c1f5-4ca1-b45b-94f2c8c2b2b0 req-d4dcacee-ee3b-427e-a27f-315def429974 service nova] Creating event network-vif-plugged:c3893e14-5c03-4b6a-b17d-c2dc56e8e688 for instance c9f6d441-246f-479e-8e88-ea701c0f87ff on hv-cinder-76845 Nov 22 12:23:21.178143 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [req-c16666ad-c1f5-4ca1-b45b-94f2c8c2b2b0 req-d4dcacee-ee3b-427e-a27f-315def429974 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082714 Nov 22 12:23:21.179059 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 459/853] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Nov 22 12:23:21 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 12:23:21.609760 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-c536d27f-f122-46bb-a3f7-b77a3bff5bc1 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:23:21.614051 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-c536d27f-f122-46bb-a3f7-b77a3bff5bc1 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] [instance: 302ab8ef-5565-4f9b-9b91-b405d550a90d] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:23:21.621826 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-c536d27f-f122-46bb-a3f7-b77a3bff5bc1 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:21.622562 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-c536d27f-f122-46bb-a3f7-b77a3bff5bc1 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:21.623600 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-c536d27f-f122-46bb-a3f7-b77a3bff5bc1 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:21.624707 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-c536d27f-f122-46bb-a3f7-b77a3bff5bc1 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:21.703020 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-27f3375c-919d-4352-8c28-edd448d75c9e tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:23:21.703773 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-27f3375c-919d-4352-8c28-edd448d75c9e tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: c9f6d441-246f-479e-8e88-ea701c0f87ff] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:23:21.721224 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-27f3375c-919d-4352-8c28-edd448d75c9e tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:21.721677 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-27f3375c-919d-4352-8c28-edd448d75c9e tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:21.722473 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-27f3375c-919d-4352-8c28-edd448d75c9e tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:21.722902 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-27f3375c-919d-4352-8c28-edd448d75c9e tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:21.975426 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-c536d27f-f122-46bb-a3f7-b77a3bff5bc1 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1efac6c215148ce8c3ecdce1e9a8742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d392a7d77f46fcb4faa017786796fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:23:21.984366 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-c536d27f-f122-46bb-a3f7-b77a3bff5bc1 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] 10.222.0.66 "GET /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d" status: 200 len: 1521 microversion: 2.1 time: 0.378841 Nov 22 12:23:21.985962 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 395/854] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:23:21 2021] GET /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d => generated 1521 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:23:22.062519 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-27f3375c-919d-4352-8c28-edd448d75c9e tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:23:22.075420 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-27f3375c-919d-4352-8c28-edd448d75c9e tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:23:22.083428 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-27f3375c-919d-4352-8c28-edd448d75c9e tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:23:22.085344 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-27f3375c-919d-4352-8c28-edd448d75c9e tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff" status: 200 len: 1809 microversion: 2.20 time: 0.386786 Nov 22 12:23:22.088682 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 460/855] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Nov 22 12:23:21 2021] GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff => generated 1809 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 12:23:22.167946 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-4f1b9da6-dd12-483e-854e-b14eb6d445b2 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:23:22.168605 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-4f1b9da6-dd12-483e-854e-b14eb6d445b2 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: 2306113c-8f98-42fd-8c0c-3dfac98fff21] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:23:22.177001 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-4f1b9da6-dd12-483e-854e-b14eb6d445b2 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:22.180345 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-4f1b9da6-dd12-483e-854e-b14eb6d445b2 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:22.184444 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-4f1b9da6-dd12-483e-854e-b14eb6d445b2 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:22.184611 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-4f1b9da6-dd12-483e-854e-b14eb6d445b2 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:22.274967 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-b8940870-fd58-4736-a057-3678c342d5e7 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:23:22.276379 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-b8940870-fd58-4736-a057-3678c342d5e7 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] [instance: 82e102ee-4d06-4e2d-8ce4-2bf3a8d0a874] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:23:22.287222 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-b8940870-fd58-4736-a057-3678c342d5e7 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:22.288090 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-b8940870-fd58-4736-a057-3678c342d5e7 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:22.289633 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-b8940870-fd58-4736-a057-3678c342d5e7 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:22.290279 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-b8940870-fd58-4736-a057-3678c342d5e7 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:22.332193 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-b8940870-fd58-4736-a057-3678c342d5e7 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] [instance: 82e102ee-4d06-4e2d-8ce4-2bf3a8d0a874] Going to try to terminate instance {{(pid=116272) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 22 12:23:22.443420 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-4f1b9da6-dd12-483e-854e-b14eb6d445b2 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41d885b9b854d8db11da5d325552301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f5dffe9bc3f41c7a2656d194fd02173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:23:22.450642 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-b8940870-fd58-4736-a057-3678c342d5e7 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] 10.222.0.66 "DELETE /compute/v2.1/servers/82e102ee-4d06-4e2d-8ce4-2bf3a8d0a874" status: 204 len: 0 microversion: 2.1 time: 0.179512 Nov 22 12:23:22.452155 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 461/856] 10.222.0.66 () {58 vars in 1238 bytes} [Mon Nov 22 12:23:22 2021] DELETE /compute/v2.1/servers/82e102ee-4d06-4e2d-8ce4-2bf3a8d0a874 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 22 12:23:22.459419 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-4f1b9da6-dd12-483e-854e-b14eb6d445b2 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "GET /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21" status: 200 len: 1723 microversion: 2.1 time: 0.295427 Nov 22 12:23:22.460289 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 396/857] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:23:22 2021] GET /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21 => generated 1723 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:23:22.470554 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-7d4b91c3-f747-4d47-b7b5-b3973e8359b8 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:23:22.470554 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-7d4b91c3-f747-4d47-b7b5-b3973e8359b8 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] [instance: 82e102ee-4d06-4e2d-8ce4-2bf3a8d0a874] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:23:22.479489 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-7d4b91c3-f747-4d47-b7b5-b3973e8359b8 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:22.480485 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-7d4b91c3-f747-4d47-b7b5-b3973e8359b8 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:22.481441 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-7d4b91c3-f747-4d47-b7b5-b3973e8359b8 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:22.482203 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-7d4b91c3-f747-4d47-b7b5-b3973e8359b8 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:22.705189 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-7d4b91c3-f747-4d47-b7b5-b3973e8359b8 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc29a63c701941f9909e8235c80f5ce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc74b1d74b14a009699279eb128f9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:23:22.726177 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-7d4b91c3-f747-4d47-b7b5-b3973e8359b8 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] 10.222.0.66 "GET /compute/v2.1/servers/82e102ee-4d06-4e2d-8ce4-2bf3a8d0a874" status: 200 len: 1514 microversion: 2.1 time: 0.267503 Nov 22 12:23:22.737565 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 462/858] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:23:22 2021] GET /compute/v2.1/servers/82e102ee-4d06-4e2d-8ce4-2bf3a8d0a874 => generated 1514 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:23:23.007467 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-0aa9885b-551d-4d3a-bc64-3ac0bf28dc09 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:23:23.010052 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-0aa9885b-551d-4d3a-bc64-3ac0bf28dc09 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] [instance: 302ab8ef-5565-4f9b-9b91-b405d550a90d] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:23:23.029121 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-0aa9885b-551d-4d3a-bc64-3ac0bf28dc09 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:23.029579 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-0aa9885b-551d-4d3a-bc64-3ac0bf28dc09 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:23.030823 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-0aa9885b-551d-4d3a-bc64-3ac0bf28dc09 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:23.031301 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-0aa9885b-551d-4d3a-bc64-3ac0bf28dc09 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:23.111700 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-fb701b88-75e4-4bf2-9d74-8e85b3e63473 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:23:23.112677 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-fb701b88-75e4-4bf2-9d74-8e85b3e63473 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: c9f6d441-246f-479e-8e88-ea701c0f87ff] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:23:23.123877 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-fb701b88-75e4-4bf2-9d74-8e85b3e63473 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:23.124764 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-fb701b88-75e4-4bf2-9d74-8e85b3e63473 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:23.126382 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-fb701b88-75e4-4bf2-9d74-8e85b3e63473 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:23.127111 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-fb701b88-75e4-4bf2-9d74-8e85b3e63473 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:23.261037 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-0aa9885b-551d-4d3a-bc64-3ac0bf28dc09 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1efac6c215148ce8c3ecdce1e9a8742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d392a7d77f46fcb4faa017786796fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:23:23.271018 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-0aa9885b-551d-4d3a-bc64-3ac0bf28dc09 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] 10.222.0.66 "GET /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d" status: 200 len: 1521 microversion: 2.1 time: 0.271680 Nov 22 12:23:23.271874 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 397/859] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:23:22 2021] GET /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d => generated 1521 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:23:23.334045 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-fb701b88-75e4-4bf2-9d74-8e85b3e63473 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:23:23.344704 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-fb701b88-75e4-4bf2-9d74-8e85b3e63473 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:23:23.346563 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-fb701b88-75e4-4bf2-9d74-8e85b3e63473 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:23:23.347786 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-fb701b88-75e4-4bf2-9d74-8e85b3e63473 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff" status: 200 len: 1809 microversion: 2.20 time: 0.245914 Nov 22 12:23:23.348342 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 463/860] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Nov 22 12:23:23 2021] GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff => generated 1809 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 12:23:23.480967 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-48619e3a-b55d-4bcd-87ff-0a9f4b89768e tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:23:23.481854 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-48619e3a-b55d-4bcd-87ff-0a9f4b89768e tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: 2306113c-8f98-42fd-8c0c-3dfac98fff21] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:23:23.490263 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-48619e3a-b55d-4bcd-87ff-0a9f4b89768e tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:23.490862 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-48619e3a-b55d-4bcd-87ff-0a9f4b89768e tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:23.492315 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-48619e3a-b55d-4bcd-87ff-0a9f4b89768e tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:23.492315 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-48619e3a-b55d-4bcd-87ff-0a9f4b89768e tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:23.684084 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-48619e3a-b55d-4bcd-87ff-0a9f4b89768e tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41d885b9b854d8db11da5d325552301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f5dffe9bc3f41c7a2656d194fd02173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:23:23.693345 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-48619e3a-b55d-4bcd-87ff-0a9f4b89768e tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "GET /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21" status: 200 len: 1723 microversion: 2.1 time: 0.218819 Nov 22 12:23:23.694588 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 398/861] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:23:23 2021] GET /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21 => generated 1723 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:23:23.747167 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-c38dfebe-3d79-4118-8ade-d8a7345dae09 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:23:23.747805 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-c38dfebe-3d79-4118-8ade-d8a7345dae09 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] [instance: 82e102ee-4d06-4e2d-8ce4-2bf3a8d0a874] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:23:23.757891 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-c38dfebe-3d79-4118-8ade-d8a7345dae09 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:23.758869 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-c38dfebe-3d79-4118-8ade-d8a7345dae09 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:23.761920 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-c38dfebe-3d79-4118-8ade-d8a7345dae09 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:23.762365 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-c38dfebe-3d79-4118-8ade-d8a7345dae09 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:23.984299 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-c38dfebe-3d79-4118-8ade-d8a7345dae09 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc29a63c701941f9909e8235c80f5ce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc74b1d74b14a009699279eb128f9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:23:23.996231 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-c38dfebe-3d79-4118-8ade-d8a7345dae09 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] 10.222.0.66 "GET /compute/v2.1/servers/82e102ee-4d06-4e2d-8ce4-2bf3a8d0a874" status: 200 len: 1514 microversion: 2.1 time: 0.254740 Nov 22 12:23:24.006040 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 464/862] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:23:23 2021] GET /compute/v2.1/servers/82e102ee-4d06-4e2d-8ce4-2bf3a8d0a874 => generated 1514 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:23:24.289794 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-ba3db815-e946-449d-a575-457ff4123b36 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:23:24.291036 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-ba3db815-e946-449d-a575-457ff4123b36 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] [instance: 302ab8ef-5565-4f9b-9b91-b405d550a90d] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:23:24.324702 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-ba3db815-e946-449d-a575-457ff4123b36 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:24.325779 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-ba3db815-e946-449d-a575-457ff4123b36 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:24.327423 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-ba3db815-e946-449d-a575-457ff4123b36 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:24.328243 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-ba3db815-e946-449d-a575-457ff4123b36 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:24.389608 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-e4bdb2f5-40c0-4b3c-a70b-0855b967a591 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:23:24.394084 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-e4bdb2f5-40c0-4b3c-a70b-0855b967a591 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: c9f6d441-246f-479e-8e88-ea701c0f87ff] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:23:24.416378 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-e4bdb2f5-40c0-4b3c-a70b-0855b967a591 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:24.417735 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-e4bdb2f5-40c0-4b3c-a70b-0855b967a591 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:24.419484 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-e4bdb2f5-40c0-4b3c-a70b-0855b967a591 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:24.420358 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-e4bdb2f5-40c0-4b3c-a70b-0855b967a591 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:24.583177 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-ba3db815-e946-449d-a575-457ff4123b36 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1efac6c215148ce8c3ecdce1e9a8742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d392a7d77f46fcb4faa017786796fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:23:24.596280 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-ba3db815-e946-449d-a575-457ff4123b36 tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] 10.222.0.66 "GET /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d" status: 200 len: 1521 microversion: 2.1 time: 0.310021 Nov 22 12:23:24.597927 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 399/863] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:23:24 2021] GET /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d => generated 1521 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:23:24.712384 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-3610a804-f03a-4d5d-add8-c52bd3fc3fcb tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:23:24.713829 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-e4bdb2f5-40c0-4b3c-a70b-0855b967a591 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:23:24.714037 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-3610a804-f03a-4d5d-add8-c52bd3fc3fcb tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: 2306113c-8f98-42fd-8c0c-3dfac98fff21] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:23:24.723199 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-3610a804-f03a-4d5d-add8-c52bd3fc3fcb tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:24.725032 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-3610a804-f03a-4d5d-add8-c52bd3fc3fcb tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:24.726157 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-3610a804-f03a-4d5d-add8-c52bd3fc3fcb tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:24.727018 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-e4bdb2f5-40c0-4b3c-a70b-0855b967a591 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:23:24.728576 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-3610a804-f03a-4d5d-add8-c52bd3fc3fcb tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:24.729752 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-e4bdb2f5-40c0-4b3c-a70b-0855b967a591 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:23:24.731114 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-e4bdb2f5-40c0-4b3c-a70b-0855b967a591 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff" status: 200 len: 1809 microversion: 2.20 time: 0.346435 Nov 22 12:23:24.732129 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 465/864] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Nov 22 12:23:24 2021] GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff => generated 1809 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 12:23:24.941958 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-3610a804-f03a-4d5d-add8-c52bd3fc3fcb tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41d885b9b854d8db11da5d325552301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f5dffe9bc3f41c7a2656d194fd02173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:23:24.959470 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-3610a804-f03a-4d5d-add8-c52bd3fc3fcb tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "GET /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21" status: 200 len: 1723 microversion: 2.1 time: 0.250984 Nov 22 12:23:24.960637 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 400/865] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:23:24 2021] GET /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21 => generated 1723 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:23:25.013776 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-98f8f7df-a3b6-4f36-855b-bc6a2ebd4767 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:23:25.014347 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-98f8f7df-a3b6-4f36-855b-bc6a2ebd4767 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] [instance: 82e102ee-4d06-4e2d-8ce4-2bf3a8d0a874] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:23:25.025164 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-98f8f7df-a3b6-4f36-855b-bc6a2ebd4767 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:25.025701 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-98f8f7df-a3b6-4f36-855b-bc6a2ebd4767 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:25.026560 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-98f8f7df-a3b6-4f36-855b-bc6a2ebd4767 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:25.027001 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-98f8f7df-a3b6-4f36-855b-bc6a2ebd4767 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:25.269278 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-98f8f7df-a3b6-4f36-855b-bc6a2ebd4767 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc29a63c701941f9909e8235c80f5ce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc74b1d74b14a009699279eb128f9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:23:25.278280 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-98f8f7df-a3b6-4f36-855b-bc6a2ebd4767 tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] 10.222.0.66 "GET /compute/v2.1/servers/82e102ee-4d06-4e2d-8ce4-2bf3a8d0a874" status: 200 len: 1514 microversion: 2.1 time: 0.268233 Nov 22 12:23:25.279135 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 466/866] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:23:25 2021] GET /compute/v2.1/servers/82e102ee-4d06-4e2d-8ce4-2bf3a8d0a874 => generated 1514 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:23:25.440997 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-71c92d37-0791-47a1-a0a0-b5086484ba25 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Action: 'create', calling method: .version_select at 0x7fa1a3376670>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-174317760"}} {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:23:25.456990 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.quota [None req-71c92d37-0791-47a1-a0a0-b5086484ba25 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Getting quotas for project 7b282b4e5e2147a692e990f45ce44b8f. Resources: {'key_pairs'} {{(pid=116273) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 22 12:23:25.461175 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.quota [None req-71c92d37-0791-47a1-a0a0-b5086484ba25 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Getting quotas for user fc2a99b8e8f244aab8bd6545355ee044 and project 7b282b4e5e2147a692e990f45ce44b8f. Resources: {'key_pairs'} {{(pid=116273) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 22 12:23:25.623340 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-a41d5c37-356d-4cd0-8906-5b9de84da7da tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:23:25.624330 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-a41d5c37-356d-4cd0-8906-5b9de84da7da tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] [instance: 302ab8ef-5565-4f9b-9b91-b405d550a90d] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:23:25.633870 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-a41d5c37-356d-4cd0-8906-5b9de84da7da tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:25.634710 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-a41d5c37-356d-4cd0-8906-5b9de84da7da tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:25.635739 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-a41d5c37-356d-4cd0-8906-5b9de84da7da tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:25.636556 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-a41d5c37-356d-4cd0-8906-5b9de84da7da tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:25.831065 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-a41d5c37-356d-4cd0-8906-5b9de84da7da tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1efac6c215148ce8c3ecdce1e9a8742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d392a7d77f46fcb4faa017786796fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:23:25.846986 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.quota [None req-71c92d37-0791-47a1-a0a0-b5086484ba25 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Getting quotas for project 7b282b4e5e2147a692e990f45ce44b8f. Resources: {'key_pairs'} {{(pid=116273) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 22 12:23:25.847625 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-a41d5c37-356d-4cd0-8906-5b9de84da7da tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] 10.222.0.66 "GET /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d" status: 200 len: 1521 microversion: 2.1 time: 0.228130 Nov 22 12:23:25.848226 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 467/867] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:23:25 2021] GET /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d => generated 1521 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 12:23:25.851540 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.quota [None req-71c92d37-0791-47a1-a0a0-b5086484ba25 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Getting quotas for user fc2a99b8e8f244aab8bd6545355ee044 and project 7b282b4e5e2147a692e990f45ce44b8f. Resources: {'key_pairs'} {{(pid=116273) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 22 12:23:25.862552 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [req-c26e1526-7e9c-472d-a8c8-5a0796b1cb22 req-26323b87-93d9-47df-9f03-41fe279a0c64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82e102ee-4d06-4e2d-8ce4-2bf3a8d0a874", "name": "network-vif-deleted", "tag": "278a21ab-1eb3-4777-ad07-2e2975db29ac"}]} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:23:25.864847 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 12:23:25.864847 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: warnings.warn(msg) Nov 22 12:23:25.874050 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [req-c26e1526-7e9c-472d-a8c8-5a0796b1cb22 req-26323b87-93d9-47df-9f03-41fe279a0c64 service nova] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:25.874488 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [req-c26e1526-7e9c-472d-a8c8-5a0796b1cb22 req-26323b87-93d9-47df-9f03-41fe279a0c64 service nova] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:25.880842 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-71c92d37-0791-47a1-a0a0-b5086484ba25 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 2321 microversion: 2.1 time: 0.443744 Nov 22 12:23:25.881707 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 401/868] 10.222.0.66 () {60 vars in 1157 bytes} [Mon Nov 22 12:23:25 2021] POST /compute/v2.1/os-keypairs => generated 2321 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:23:25.889465 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-0a5f18d1-89af-492e-9edd-46694ed0e087 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:23:25.895294 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.compute.server_external_events [req-c26e1526-7e9c-472d-a8c8-5a0796b1cb22 req-26323b87-93d9-47df-9f03-41fe279a0c64 service nova] Creating event network-vif-deleted:278a21ab-1eb3-4777-ad07-2e2975db29ac for instance 82e102ee-4d06-4e2d-8ce4-2bf3a8d0a874 on hv-cinder-76845 Nov 22 12:23:25.901548 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-0a5f18d1-89af-492e-9edd-46694ed0e087 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: c9f6d441-246f-479e-8e88-ea701c0f87ff] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:23:25.902607 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [req-c26e1526-7e9c-472d-a8c8-5a0796b1cb22 req-26323b87-93d9-47df-9f03-41fe279a0c64 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049657 Nov 22 12:23:25.903492 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 468/869] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Nov 22 12:23:25 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 12:23:25.908829 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-0a5f18d1-89af-492e-9edd-46694ed0e087 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:25.909289 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-0a5f18d1-89af-492e-9edd-46694ed0e087 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:25.910093 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-0a5f18d1-89af-492e-9edd-46694ed0e087 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:25.910534 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-0a5f18d1-89af-492e-9edd-46694ed0e087 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:25.983628 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-51e45ff6-b7a1-4d72-8685-3155bb7fb1fc tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:23:25.984967 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-51e45ff6-b7a1-4d72-8685-3155bb7fb1fc tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: 2306113c-8f98-42fd-8c0c-3dfac98fff21] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:23:25.991932 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-51e45ff6-b7a1-4d72-8685-3155bb7fb1fc tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:25.992744 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-51e45ff6-b7a1-4d72-8685-3155bb7fb1fc tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:25.994859 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-51e45ff6-b7a1-4d72-8685-3155bb7fb1fc tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:25.995334 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-51e45ff6-b7a1-4d72-8685-3155bb7fb1fc tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:26.083712 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-0a5f18d1-89af-492e-9edd-46694ed0e087 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:23:26.097594 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-0a5f18d1-89af-492e-9edd-46694ed0e087 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:23:26.099066 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-0a5f18d1-89af-492e-9edd-46694ed0e087 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:23:26.100237 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-0a5f18d1-89af-492e-9edd-46694ed0e087 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff" status: 200 len: 1796 microversion: 2.20 time: 0.217835 Nov 22 12:23:26.100784 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 402/870] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Nov 22 12:23:25 2021] GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff => generated 1796 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 12:23:26.105714 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-ee0ad629-ad52-4eec-8a50-8df761006152 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-350625898", "imageRef": "50587c99-0487-42b8-978e-8d5b37b9645c", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-174317760", "networks": [{"uuid": "3bb69f26-c969-40f0-8e57-593fe240347b"}]}} {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:23:26.166117 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.network.neutron [None req-ee0ad629-ad52-4eec-8a50-8df761006152 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] validate_networks() for [('3bb69f26-c969-40f0-8e57-593fe240347b', None, None, None, None, None)] {{(pid=116273) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 22 12:23:26.244574 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-51e45ff6-b7a1-4d72-8685-3155bb7fb1fc tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41d885b9b854d8db11da5d325552301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f5dffe9bc3f41c7a2656d194fd02173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:23:26.253743 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-51e45ff6-b7a1-4d72-8685-3155bb7fb1fc tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "GET /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21" status: 200 len: 1723 microversion: 2.1 time: 0.279246 Nov 22 12:23:26.255001 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 469/871] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:23:25 2021] GET /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21 => generated 1723 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 12:23:26.297902 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-d0c00c15-d935-4225-a2d1-4f1e01de354a tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:23:26.298774 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-d0c00c15-d935-4225-a2d1-4f1e01de354a tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] [instance: 82e102ee-4d06-4e2d-8ce4-2bf3a8d0a874] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:23:26.306159 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-d0c00c15-d935-4225-a2d1-4f1e01de354a tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:26.307715 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-d0c00c15-d935-4225-a2d1-4f1e01de354a tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:26.319401 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-d0c00c15-d935-4225-a2d1-4f1e01de354a tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:26.320148 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-d0c00c15-d935-4225-a2d1-4f1e01de354a tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:26.360043 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-d0c00c15-d935-4225-a2d1-4f1e01de354a tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:26.360874 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-d0c00c15-d935-4225-a2d1-4f1e01de354a tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:26.361683 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.objects.instance [None req-d0c00c15-d935-4225-a2d1-4f1e01de354a tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lazy-loading 'fault' on Instance uuid 82e102ee-4d06-4e2d-8ce4-2bf3a8d0a874 {{(pid=116272) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 22 12:23:26.421080 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-d0c00c15-d935-4225-a2d1-4f1e01de354a tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc29a63c701941f9909e8235c80f5ce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc74b1d74b14a009699279eb128f9f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:23:26.428328 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-d0c00c15-d935-4225-a2d1-4f1e01de354a tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] 10.222.0.66 "GET /compute/v2.1/servers/82e102ee-4d06-4e2d-8ce4-2bf3a8d0a874" status: 200 len: 1309 microversion: 2.1 time: 0.134018 Nov 22 12:23:26.429188 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 470/872] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:23:26 2021] GET /compute/v2.1/servers/82e102ee-4d06-4e2d-8ce4-2bf3a8d0a874 => generated 1309 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 12:23:26.798951 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.virt.hardware [None req-ee0ad629-ad52-4eec-8a50-8df761006152 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Flavor limits 0:0:0 {{(pid=116273) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 22 12:23:26.799827 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.virt.hardware [None req-ee0ad629-ad52-4eec-8a50-8df761006152 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Image limits 0:0:0 {{(pid=116273) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 22 12:23:26.800330 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.virt.hardware [None req-ee0ad629-ad52-4eec-8a50-8df761006152 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Flavor pref 0:0:0 {{(pid=116273) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 22 12:23:26.800653 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.virt.hardware [None req-ee0ad629-ad52-4eec-8a50-8df761006152 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Image pref 0:0:0 {{(pid=116273) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 22 12:23:26.801083 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.virt.hardware [None req-ee0ad629-ad52-4eec-8a50-8df761006152 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116273) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 22 12:23:26.810664 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-ee0ad629-ad52-4eec-8a50-8df761006152 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:26.811118 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-ee0ad629-ad52-4eec-8a50-8df761006152 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:26.811965 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-ee0ad629-ad52-4eec-8a50-8df761006152 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:26.812400 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-ee0ad629-ad52-4eec-8a50-8df761006152 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:26.830805 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.quota [None req-ee0ad629-ad52-4eec-8a50-8df761006152 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Getting quotas for project 7b282b4e5e2147a692e990f45ce44b8f. Resources: {'ram', 'instances', 'cores'} {{(pid=116273) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 22 12:23:26.835799 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.quota [None req-ee0ad629-ad52-4eec-8a50-8df761006152 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Getting quotas for user fc2a99b8e8f244aab8bd6545355ee044 and project 7b282b4e5e2147a692e990f45ce44b8f. Resources: {'ram', 'instances', 'cores'} {{(pid=116273) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 22 12:23:26.849650 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-ee0ad629-ad52-4eec-8a50-8df761006152 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Going to run 1 instances... {{(pid=116273) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 22 12:23:26.852025 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-ee0ad629-ad52-4eec-8a50-8df761006152 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] [instance: 131dcb5b-f62d-42ec-b0d0-588a120aa1d3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='50587c99-0487-42b8-978e-8d5b37b9645c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116273) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 22 12:23:26.871480 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-33736f8f-8a49-4954-acd4-c30eafb38b3e tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:23:26.872648 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-33736f8f-8a49-4954-acd4-c30eafb38b3e tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] [instance: 302ab8ef-5565-4f9b-9b91-b405d550a90d] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:23:26.882514 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-33736f8f-8a49-4954-acd4-c30eafb38b3e tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:26.883697 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-33736f8f-8a49-4954-acd4-c30eafb38b3e tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:26.885509 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-33736f8f-8a49-4954-acd4-c30eafb38b3e tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:26.886132 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-33736f8f-8a49-4954-acd4-c30eafb38b3e tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:26.904285 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-ee0ad629-ad52-4eec-8a50-8df761006152 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.802229 Nov 22 12:23:26.905559 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 403/873] 10.222.0.66 () {60 vars in 1146 bytes} [Mon Nov 22 12:23:26 2021] POST /compute/v2.1/servers => generated 380 bytes in 804 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 22 12:23:26.918839 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-ba5f73b0-8738-4c83-b493-d23a638b2448 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:23:26.919788 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-ba5f73b0-8738-4c83-b493-d23a638b2448 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] [instance: 131dcb5b-f62d-42ec-b0d0-588a120aa1d3] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:23:26.996400 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-ba5f73b0-8738-4c83-b493-d23a638b2448 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc2a99b8e8f244aab8bd6545355ee044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b282b4e5e2147a692e990f45ce44b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:23:27.006820 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-ba5f73b0-8738-4c83-b493-d23a638b2448 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] 10.222.0.66 "GET /compute/v2.1/servers/131dcb5b-f62d-42ec-b0d0-588a120aa1d3" status: 200 len: 1257 microversion: 2.1 time: 0.094840 Nov 22 12:23:27.008142 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 404/874] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:23:26 2021] GET /compute/v2.1/servers/131dcb5b-f62d-42ec-b0d0-588a120aa1d3 => generated 1257 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:23:27.274579 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-6f863f92-a3ec-4031-baaf-75b2250b15a7 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:23:27.275818 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-6f863f92-a3ec-4031-baaf-75b2250b15a7 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: 2306113c-8f98-42fd-8c0c-3dfac98fff21] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:23:27.283914 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-6f863f92-a3ec-4031-baaf-75b2250b15a7 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:27.284672 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-6f863f92-a3ec-4031-baaf-75b2250b15a7 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:27.285651 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-6f863f92-a3ec-4031-baaf-75b2250b15a7 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:27.286165 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-6f863f92-a3ec-4031-baaf-75b2250b15a7 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:27.511592 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-33736f8f-8a49-4954-acd4-c30eafb38b3e tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1efac6c215148ce8c3ecdce1e9a8742', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3d392a7d77f46fcb4faa017786796fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:23:27.521654 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-33736f8f-8a49-4954-acd4-c30eafb38b3e tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] 10.222.0.66 "GET /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d" status: 200 len: 1521 microversion: 2.1 time: 0.655013 Nov 22 12:23:27.522352 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 471/875] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:23:26 2021] GET /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d => generated 1521 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 12:23:27.527447 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-a87563f3-2637-4d55-9c8c-71fe11dadefb tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:23:27.528192 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-a87563f3-2637-4d55-9c8c-71fe11dadefb tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] [instance: 82e102ee-4d06-4e2d-8ce4-2bf3a8d0a874] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:23:27.537493 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-a87563f3-2637-4d55-9c8c-71fe11dadefb tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:27.538241 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-a87563f3-2637-4d55-9c8c-71fe11dadefb tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:27.539343 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-a87563f3-2637-4d55-9c8c-71fe11dadefb tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:27.540030 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-a87563f3-2637-4d55-9c8c-71fe11dadefb tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:27.561226 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.wsgi [None req-a87563f3-2637-4d55-9c8c-71fe11dadefb tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] HTTP exception thrown: Instance 82e102ee-4d06-4e2d-8ce4-2bf3a8d0a874 could not be found. Nov 22 12:23:27.561974 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-a87563f3-2637-4d55-9c8c-71fe11dadefb tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] Returning 404 to user: Instance 82e102ee-4d06-4e2d-8ce4-2bf3a8d0a874 could not be found. {{(pid=116272) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 12:23:27.563409 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-a87563f3-2637-4d55-9c8c-71fe11dadefb tempest-VolumesSnapshotTestJSON-1978321900 tempest-VolumesSnapshotTestJSON-1978321900-project] 10.222.0.66 "GET /compute/v2.1/servers/82e102ee-4d06-4e2d-8ce4-2bf3a8d0a874" status: 404 len: 111 microversion: 2.1 time: 0.039597 Nov 22 12:23:27.563824 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 472/876] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:23:27 2021] GET /compute/v2.1/servers/82e102ee-4d06-4e2d-8ce4-2bf3a8d0a874 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 22 12:23:27.640202 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-6f863f92-a3ec-4031-baaf-75b2250b15a7 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41d885b9b854d8db11da5d325552301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f5dffe9bc3f41c7a2656d194fd02173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:23:27.651049 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-6f863f92-a3ec-4031-baaf-75b2250b15a7 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "GET /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21" status: 200 len: 1723 microversion: 2.1 time: 0.382504 Nov 22 12:23:27.651817 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 405/877] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:23:27 2021] GET /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21 => generated 1723 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:23:27.920674 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [req-0b918359-31a1-4844-94ca-cb30eba5d054 req-46f99047-a4e8-4189-8378-639871f90a6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "302ab8ef-5565-4f9b-9b91-b405d550a90d", "name": "network-vif-deleted", "tag": "1fa9e48d-814b-49fa-b645-de1efce73a7d"}]} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:23:27.922227 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 12:23:27.922227 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: warnings.warn(msg) Nov 22 12:23:27.929457 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [req-0b918359-31a1-4844-94ca-cb30eba5d054 req-46f99047-a4e8-4189-8378-639871f90a6b service nova] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:27.929851 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [req-0b918359-31a1-4844-94ca-cb30eba5d054 req-46f99047-a4e8-4189-8378-639871f90a6b service nova] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:27.943156 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.compute.server_external_events [req-0b918359-31a1-4844-94ca-cb30eba5d054 req-46f99047-a4e8-4189-8378-639871f90a6b service nova] Creating event network-vif-deleted:1fa9e48d-814b-49fa-b645-de1efce73a7d for instance 302ab8ef-5565-4f9b-9b91-b405d550a90d on hv-cinder-76845 Nov 22 12:23:27.948290 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [req-0b918359-31a1-4844-94ca-cb30eba5d054 req-46f99047-a4e8-4189-8378-639871f90a6b service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031353 Nov 22 12:23:27.948988 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 473/878] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Nov 22 12:23:27 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 12:23:28.024674 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-54443d8d-78d8-4b8f-bd28-e5a122fee700 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:23:28.025689 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-54443d8d-78d8-4b8f-bd28-e5a122fee700 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] [instance: 131dcb5b-f62d-42ec-b0d0-588a120aa1d3] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:23:28.032481 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-54443d8d-78d8-4b8f-bd28-e5a122fee700 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:28.033255 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-54443d8d-78d8-4b8f-bd28-e5a122fee700 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:28.034102 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-54443d8d-78d8-4b8f-bd28-e5a122fee700 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:28.034733 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-54443d8d-78d8-4b8f-bd28-e5a122fee700 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:28.103381 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-54443d8d-78d8-4b8f-bd28-e5a122fee700 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc2a99b8e8f244aab8bd6545355ee044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b282b4e5e2147a692e990f45ce44b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:23:28.111158 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-54443d8d-78d8-4b8f-bd28-e5a122fee700 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] 10.222.0.66 "GET /compute/v2.1/servers/131dcb5b-f62d-42ec-b0d0-588a120aa1d3" status: 200 len: 1309 microversion: 2.1 time: 0.090411 Nov 22 12:23:28.123610 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 406/879] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:23:28 2021] GET /compute/v2.1/servers/131dcb5b-f62d-42ec-b0d0-588a120aa1d3 => generated 1309 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:23:28.547723 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-66d2e695-1edc-443e-95c3-3c67a59914ef tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:23:28.548444 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-66d2e695-1edc-443e-95c3-3c67a59914ef tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] [instance: 302ab8ef-5565-4f9b-9b91-b405d550a90d] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:23:28.557682 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-66d2e695-1edc-443e-95c3-3c67a59914ef tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:28.558148 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-66d2e695-1edc-443e-95c3-3c67a59914ef tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:28.558961 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-66d2e695-1edc-443e-95c3-3c67a59914ef tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:28.559439 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-66d2e695-1edc-443e-95c3-3c67a59914ef tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:28.578139 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.wsgi [None req-66d2e695-1edc-443e-95c3-3c67a59914ef tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] HTTP exception thrown: Instance 302ab8ef-5565-4f9b-9b91-b405d550a90d could not be found. Nov 22 12:23:28.579044 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-66d2e695-1edc-443e-95c3-3c67a59914ef tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] Returning 404 to user: Instance 302ab8ef-5565-4f9b-9b91-b405d550a90d could not be found. {{(pid=116272) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 12:23:28.580057 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-66d2e695-1edc-443e-95c3-3c67a59914ef tempest-ServerRescueNegativeTestJSON-1281797072 tempest-ServerRescueNegativeTestJSON-1281797072-project] 10.222.0.66 "GET /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d" status: 404 len: 111 microversion: 2.1 time: 0.044789 Nov 22 12:23:28.580811 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 474/880] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:23:28 2021] GET /compute/v2.1/servers/302ab8ef-5565-4f9b-9b91-b405d550a90d => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 22 12:23:28.672075 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-c09dd810-b0de-4197-9b3e-63f3b91f8f2f tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:23:28.672846 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-c09dd810-b0de-4197-9b3e-63f3b91f8f2f tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: 2306113c-8f98-42fd-8c0c-3dfac98fff21] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:23:28.684265 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-c09dd810-b0de-4197-9b3e-63f3b91f8f2f tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:28.685123 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-c09dd810-b0de-4197-9b3e-63f3b91f8f2f tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:28.691002 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-c09dd810-b0de-4197-9b3e-63f3b91f8f2f tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:28.691999 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-c09dd810-b0de-4197-9b3e-63f3b91f8f2f tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:29.138182 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-48227e67-11ff-42b5-97a7-490a84dbf49a tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:23:29.139143 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-48227e67-11ff-42b5-97a7-490a84dbf49a tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] [instance: 131dcb5b-f62d-42ec-b0d0-588a120aa1d3] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:23:29.151575 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-48227e67-11ff-42b5-97a7-490a84dbf49a tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:29.161602 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-48227e67-11ff-42b5-97a7-490a84dbf49a tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:29.163505 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-48227e67-11ff-42b5-97a7-490a84dbf49a tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:29.166615 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-48227e67-11ff-42b5-97a7-490a84dbf49a tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:29.232179 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-c09dd810-b0de-4197-9b3e-63f3b91f8f2f tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41d885b9b854d8db11da5d325552301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f5dffe9bc3f41c7a2656d194fd02173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:23:29.247875 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-c09dd810-b0de-4197-9b3e-63f3b91f8f2f tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "GET /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21" status: 200 len: 1723 microversion: 2.1 time: 0.581997 Nov 22 12:23:29.250842 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 407/881] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:23:28 2021] GET /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21 => generated 1723 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:23:29.608176 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-48227e67-11ff-42b5-97a7-490a84dbf49a tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc2a99b8e8f244aab8bd6545355ee044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b282b4e5e2147a692e990f45ce44b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:23:29.623638 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-48227e67-11ff-42b5-97a7-490a84dbf49a tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] 10.222.0.66 "GET /compute/v2.1/servers/131dcb5b-f62d-42ec-b0d0-588a120aa1d3" status: 200 len: 1357 microversion: 2.1 time: 0.488759 Nov 22 12:23:29.626080 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 475/882] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:23:29 2021] GET /compute/v2.1/servers/131dcb5b-f62d-42ec-b0d0-588a120aa1d3 => generated 1357 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:23:30.270348 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-fb88502c-301a-4a4b-b457-217263d450c4 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:23:30.274643 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-fb88502c-301a-4a4b-b457-217263d450c4 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: 2306113c-8f98-42fd-8c0c-3dfac98fff21] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:23:30.291665 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-fb88502c-301a-4a4b-b457-217263d450c4 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:30.292889 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-fb88502c-301a-4a4b-b457-217263d450c4 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:30.293802 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-fb88502c-301a-4a4b-b457-217263d450c4 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:30.294235 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-fb88502c-301a-4a4b-b457-217263d450c4 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:30.620229 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-fb88502c-301a-4a4b-b457-217263d450c4 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41d885b9b854d8db11da5d325552301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f5dffe9bc3f41c7a2656d194fd02173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:23:30.629250 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-fb88502c-301a-4a4b-b457-217263d450c4 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "GET /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21" status: 200 len: 1723 microversion: 2.1 time: 0.363065 Nov 22 12:23:30.636164 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 408/883] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:23:30 2021] GET /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21 => generated 1723 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:23:30.647998 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-0dce2196-73ce-40ea-b439-4d660ffdd3b8 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:23:30.648578 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-0dce2196-73ce-40ea-b439-4d660ffdd3b8 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] [instance: 131dcb5b-f62d-42ec-b0d0-588a120aa1d3] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:23:30.662762 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-0dce2196-73ce-40ea-b439-4d660ffdd3b8 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:30.664554 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-0dce2196-73ce-40ea-b439-4d660ffdd3b8 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:30.666072 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-0dce2196-73ce-40ea-b439-4d660ffdd3b8 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:30.669265 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-0dce2196-73ce-40ea-b439-4d660ffdd3b8 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:30.810217 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [req-7e7ce48a-5ea2-46cd-9f46-36a8c46e0488 req-65f4f74c-7677-4c66-8cbe-9e7de99ac962 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "131dcb5b-f62d-42ec-b0d0-588a120aa1d3", "tag": "f7e46359-fc84-431c-88fd-b6af0c318ee6"}]} {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:23:30.812645 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 12:23:30.812645 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: warnings.warn(msg) Nov 22 12:23:30.822673 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [req-7e7ce48a-5ea2-46cd-9f46-36a8c46e0488 req-65f4f74c-7677-4c66-8cbe-9e7de99ac962 service nova] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:30.823435 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [req-7e7ce48a-5ea2-46cd-9f46-36a8c46e0488 req-65f4f74c-7677-4c66-8cbe-9e7de99ac962 service nova] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:30.875476 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.compute.server_external_events [req-7e7ce48a-5ea2-46cd-9f46-36a8c46e0488 req-65f4f74c-7677-4c66-8cbe-9e7de99ac962 service nova] Creating event network-changed:f7e46359-fc84-431c-88fd-b6af0c318ee6 for instance 131dcb5b-f62d-42ec-b0d0-588a120aa1d3 on hv-cinder-76845 Nov 22 12:23:30.889182 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [req-7e7ce48a-5ea2-46cd-9f46-36a8c46e0488 req-65f4f74c-7677-4c66-8cbe-9e7de99ac962 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084166 Nov 22 12:23:30.891044 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 409/884] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Nov 22 12:23:30 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 22 12:23:31.096937 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-0dce2196-73ce-40ea-b439-4d660ffdd3b8 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc2a99b8e8f244aab8bd6545355ee044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b282b4e5e2147a692e990f45ce44b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:23:31.106575 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-0dce2196-73ce-40ea-b439-4d660ffdd3b8 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] 10.222.0.66 "GET /compute/v2.1/servers/131dcb5b-f62d-42ec-b0d0-588a120aa1d3" status: 200 len: 1357 microversion: 2.1 time: 0.463034 Nov 22 12:23:31.112574 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 476/885] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:23:30 2021] GET /compute/v2.1/servers/131dcb5b-f62d-42ec-b0d0-588a120aa1d3 => generated 1357 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:23:31.650611 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-a0263e07-80ff-4c58-9bf6-966e37744725 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:23:31.651955 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-a0263e07-80ff-4c58-9bf6-966e37744725 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: 2306113c-8f98-42fd-8c0c-3dfac98fff21] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:23:31.660057 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-a0263e07-80ff-4c58-9bf6-966e37744725 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:31.660750 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-a0263e07-80ff-4c58-9bf6-966e37744725 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:31.661763 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-a0263e07-80ff-4c58-9bf6-966e37744725 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:31.662171 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-a0263e07-80ff-4c58-9bf6-966e37744725 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:31.924656 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-a0263e07-80ff-4c58-9bf6-966e37744725 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41d885b9b854d8db11da5d325552301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f5dffe9bc3f41c7a2656d194fd02173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:23:31.965360 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-a0263e07-80ff-4c58-9bf6-966e37744725 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "GET /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21" status: 200 len: 1723 microversion: 2.1 time: 0.319193 Nov 22 12:23:31.966033 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 410/886] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:23:31 2021] GET /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21 => generated 1723 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:23:32.129589 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-c1d9617c-c5b1-4bf8-81b6-425db5abec6d tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:23:32.130326 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-c1d9617c-c5b1-4bf8-81b6-425db5abec6d tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] [instance: 131dcb5b-f62d-42ec-b0d0-588a120aa1d3] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:23:32.138691 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-c1d9617c-c5b1-4bf8-81b6-425db5abec6d tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:32.139323 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-c1d9617c-c5b1-4bf8-81b6-425db5abec6d tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:32.140251 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-c1d9617c-c5b1-4bf8-81b6-425db5abec6d tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:32.141249 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-c1d9617c-c5b1-4bf8-81b6-425db5abec6d tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:32.370051 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-c1d9617c-c5b1-4bf8-81b6-425db5abec6d tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc2a99b8e8f244aab8bd6545355ee044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b282b4e5e2147a692e990f45ce44b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:23:32.377935 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-c1d9617c-c5b1-4bf8-81b6-425db5abec6d tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] 10.222.0.66 "GET /compute/v2.1/servers/131dcb5b-f62d-42ec-b0d0-588a120aa1d3" status: 200 len: 1357 microversion: 2.1 time: 0.252192 Nov 22 12:23:32.378523 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 477/887] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:23:32 2021] GET /compute/v2.1/servers/131dcb5b-f62d-42ec-b0d0-588a120aa1d3 => generated 1357 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:23:32.988060 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-27cdf85a-109f-4aee-9991-2edddf12b91d tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:23:32.988667 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-27cdf85a-109f-4aee-9991-2edddf12b91d tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: 2306113c-8f98-42fd-8c0c-3dfac98fff21] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:23:33.001266 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-27cdf85a-109f-4aee-9991-2edddf12b91d tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:33.001714 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-27cdf85a-109f-4aee-9991-2edddf12b91d tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:33.002522 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-27cdf85a-109f-4aee-9991-2edddf12b91d tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:33.014666 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-27cdf85a-109f-4aee-9991-2edddf12b91d tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:33.377414 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-27cdf85a-109f-4aee-9991-2edddf12b91d tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41d885b9b854d8db11da5d325552301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f5dffe9bc3f41c7a2656d194fd02173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:23:33.389962 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-27cdf85a-109f-4aee-9991-2edddf12b91d tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "GET /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21" status: 200 len: 1723 microversion: 2.1 time: 0.408643 Nov 22 12:23:33.390659 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 411/888] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:23:32 2021] GET /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21 => generated 1723 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:23:33.398314 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-2e1092f6-bca9-4773-a7ae-28bbb4e24dcf tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:23:33.399272 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-2e1092f6-bca9-4773-a7ae-28bbb4e24dcf tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] [instance: 131dcb5b-f62d-42ec-b0d0-588a120aa1d3] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:23:33.417498 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-2e1092f6-bca9-4773-a7ae-28bbb4e24dcf tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:33.429950 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-2e1092f6-bca9-4773-a7ae-28bbb4e24dcf tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:33.431532 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-2e1092f6-bca9-4773-a7ae-28bbb4e24dcf tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:33.433589 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-2e1092f6-bca9-4773-a7ae-28bbb4e24dcf tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:34.111762 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-2e1092f6-bca9-4773-a7ae-28bbb4e24dcf tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc2a99b8e8f244aab8bd6545355ee044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b282b4e5e2147a692e990f45ce44b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:23:34.121495 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-2e1092f6-bca9-4773-a7ae-28bbb4e24dcf tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] 10.222.0.66 "GET /compute/v2.1/servers/131dcb5b-f62d-42ec-b0d0-588a120aa1d3" status: 200 len: 1357 microversion: 2.1 time: 0.731370 Nov 22 12:23:34.123863 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 478/889] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:23:33 2021] GET /compute/v2.1/servers/131dcb5b-f62d-42ec-b0d0-588a120aa1d3 => generated 1357 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 12:23:34.417200 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-85e99006-ef4e-4699-b2b6-88046eee741c tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:23:34.428547 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-85e99006-ef4e-4699-b2b6-88046eee741c tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: 2306113c-8f98-42fd-8c0c-3dfac98fff21] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:23:34.440044 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-85e99006-ef4e-4699-b2b6-88046eee741c tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:34.444800 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-85e99006-ef4e-4699-b2b6-88046eee741c tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:34.449445 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-85e99006-ef4e-4699-b2b6-88046eee741c tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:34.452982 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-85e99006-ef4e-4699-b2b6-88046eee741c tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:34.812240 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-85e99006-ef4e-4699-b2b6-88046eee741c tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41d885b9b854d8db11da5d325552301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f5dffe9bc3f41c7a2656d194fd02173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:23:34.829264 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-85e99006-ef4e-4699-b2b6-88046eee741c tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "GET /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21" status: 200 len: 1723 microversion: 2.1 time: 0.419497 Nov 22 12:23:34.829985 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 412/890] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:23:34 2021] GET /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21 => generated 1723 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:23:35.146890 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-f53ae4e9-084d-4e20-89ee-519419a8e70a tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:23:35.147852 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-f53ae4e9-084d-4e20-89ee-519419a8e70a tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] [instance: 131dcb5b-f62d-42ec-b0d0-588a120aa1d3] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:23:35.157948 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-f53ae4e9-084d-4e20-89ee-519419a8e70a tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:35.158400 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-f53ae4e9-084d-4e20-89ee-519419a8e70a tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:35.159187 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-f53ae4e9-084d-4e20-89ee-519419a8e70a tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:35.159640 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-f53ae4e9-084d-4e20-89ee-519419a8e70a tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:35.377414 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-f53ae4e9-084d-4e20-89ee-519419a8e70a tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc2a99b8e8f244aab8bd6545355ee044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b282b4e5e2147a692e990f45ce44b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:23:35.386422 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-f53ae4e9-084d-4e20-89ee-519419a8e70a tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] 10.222.0.66 "GET /compute/v2.1/servers/131dcb5b-f62d-42ec-b0d0-588a120aa1d3" status: 200 len: 1357 microversion: 2.1 time: 0.248220 Nov 22 12:23:35.392422 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 479/891] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:23:35 2021] GET /compute/v2.1/servers/131dcb5b-f62d-42ec-b0d0-588a120aa1d3 => generated 1357 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:23:35.846273 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-b28c9e4f-85d4-4b73-b701-157e1731fdbb tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:23:35.846930 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-b28c9e4f-85d4-4b73-b701-157e1731fdbb tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: 2306113c-8f98-42fd-8c0c-3dfac98fff21] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:23:35.853121 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-b28c9e4f-85d4-4b73-b701-157e1731fdbb tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:35.853559 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-b28c9e4f-85d4-4b73-b701-157e1731fdbb tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:35.864404 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-b28c9e4f-85d4-4b73-b701-157e1731fdbb tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:35.865144 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-b28c9e4f-85d4-4b73-b701-157e1731fdbb tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:36.064552 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-b28c9e4f-85d4-4b73-b701-157e1731fdbb tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41d885b9b854d8db11da5d325552301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f5dffe9bc3f41c7a2656d194fd02173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:23:36.075642 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-b28c9e4f-85d4-4b73-b701-157e1731fdbb tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "GET /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21" status: 200 len: 1723 microversion: 2.1 time: 0.232873 Nov 22 12:23:36.076591 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 413/892] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:23:35 2021] GET /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21 => generated 1723 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:23:36.407348 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-23477c59-1ab8-42e7-8587-97bbed254210 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:23:36.408194 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-23477c59-1ab8-42e7-8587-97bbed254210 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] [instance: 131dcb5b-f62d-42ec-b0d0-588a120aa1d3] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:23:36.416911 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-23477c59-1ab8-42e7-8587-97bbed254210 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:36.420229 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-23477c59-1ab8-42e7-8587-97bbed254210 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:36.421292 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-23477c59-1ab8-42e7-8587-97bbed254210 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:36.422799 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-23477c59-1ab8-42e7-8587-97bbed254210 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:36.652302 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-23477c59-1ab8-42e7-8587-97bbed254210 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc2a99b8e8f244aab8bd6545355ee044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b282b4e5e2147a692e990f45ce44b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:23:36.660456 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-23477c59-1ab8-42e7-8587-97bbed254210 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] 10.222.0.66 "GET /compute/v2.1/servers/131dcb5b-f62d-42ec-b0d0-588a120aa1d3" status: 200 len: 1357 microversion: 2.1 time: 0.257041 Nov 22 12:23:36.669650 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 480/893] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:23:36 2021] GET /compute/v2.1/servers/131dcb5b-f62d-42ec-b0d0-588a120aa1d3 => generated 1357 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:23:37.098890 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-a4fa8576-28d8-4b04-bbec-2c0efcd00b03 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:23:37.099728 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-a4fa8576-28d8-4b04-bbec-2c0efcd00b03 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: 2306113c-8f98-42fd-8c0c-3dfac98fff21] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:23:37.116575 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-a4fa8576-28d8-4b04-bbec-2c0efcd00b03 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:37.117346 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-a4fa8576-28d8-4b04-bbec-2c0efcd00b03 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:37.118394 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-a4fa8576-28d8-4b04-bbec-2c0efcd00b03 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:37.119050 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-a4fa8576-28d8-4b04-bbec-2c0efcd00b03 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:37.394495 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-a4fa8576-28d8-4b04-bbec-2c0efcd00b03 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41d885b9b854d8db11da5d325552301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f5dffe9bc3f41c7a2656d194fd02173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:23:37.406015 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-a4fa8576-28d8-4b04-bbec-2c0efcd00b03 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "GET /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21" status: 200 len: 1723 microversion: 2.1 time: 0.309453 Nov 22 12:23:37.406814 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 414/894] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:23:37 2021] GET /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21 => generated 1723 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:23:37.692111 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-9af75d2e-b3f8-4def-a4ec-2ee36e65c293 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:23:37.692747 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-9af75d2e-b3f8-4def-a4ec-2ee36e65c293 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] [instance: 131dcb5b-f62d-42ec-b0d0-588a120aa1d3] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:23:37.708021 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-9af75d2e-b3f8-4def-a4ec-2ee36e65c293 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:37.708470 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-9af75d2e-b3f8-4def-a4ec-2ee36e65c293 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:37.711173 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-9af75d2e-b3f8-4def-a4ec-2ee36e65c293 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:37.711661 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-9af75d2e-b3f8-4def-a4ec-2ee36e65c293 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:37.993954 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-9af75d2e-b3f8-4def-a4ec-2ee36e65c293 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc2a99b8e8f244aab8bd6545355ee044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b282b4e5e2147a692e990f45ce44b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:23:38.003057 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-9af75d2e-b3f8-4def-a4ec-2ee36e65c293 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] 10.222.0.66 "GET /compute/v2.1/servers/131dcb5b-f62d-42ec-b0d0-588a120aa1d3" status: 200 len: 1357 microversion: 2.1 time: 0.320656 Nov 22 12:23:38.008009 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 481/895] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:23:37 2021] GET /compute/v2.1/servers/131dcb5b-f62d-42ec-b0d0-588a120aa1d3 => generated 1357 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 12:23:38.424569 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-53833ed6-bcaf-40d3-827f-d3ad8cc1579f tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:23:38.425229 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-53833ed6-bcaf-40d3-827f-d3ad8cc1579f tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: 2306113c-8f98-42fd-8c0c-3dfac98fff21] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:23:38.442978 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-53833ed6-bcaf-40d3-827f-d3ad8cc1579f tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:38.443462 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-53833ed6-bcaf-40d3-827f-d3ad8cc1579f tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:38.452221 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-53833ed6-bcaf-40d3-827f-d3ad8cc1579f tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:38.452853 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-53833ed6-bcaf-40d3-827f-d3ad8cc1579f tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:38.666378 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-53833ed6-bcaf-40d3-827f-d3ad8cc1579f tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41d885b9b854d8db11da5d325552301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f5dffe9bc3f41c7a2656d194fd02173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:23:38.675461 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-53833ed6-bcaf-40d3-827f-d3ad8cc1579f tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "GET /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21" status: 200 len: 1723 microversion: 2.1 time: 0.254896 Nov 22 12:23:38.676198 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 415/896] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:23:38 2021] GET /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21 => generated 1723 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:23:39.021603 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-32f6851f-e6ed-445a-8f74-d47f7af96b3c tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:23:39.022248 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-32f6851f-e6ed-445a-8f74-d47f7af96b3c tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] [instance: 131dcb5b-f62d-42ec-b0d0-588a120aa1d3] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:23:39.044743 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-32f6851f-e6ed-445a-8f74-d47f7af96b3c tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:39.045409 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-32f6851f-e6ed-445a-8f74-d47f7af96b3c tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:39.046375 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-32f6851f-e6ed-445a-8f74-d47f7af96b3c tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:39.046961 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-32f6851f-e6ed-445a-8f74-d47f7af96b3c tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:39.260683 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-32f6851f-e6ed-445a-8f74-d47f7af96b3c tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc2a99b8e8f244aab8bd6545355ee044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b282b4e5e2147a692e990f45ce44b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:23:39.269767 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-32f6851f-e6ed-445a-8f74-d47f7af96b3c tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] 10.222.0.66 "GET /compute/v2.1/servers/131dcb5b-f62d-42ec-b0d0-588a120aa1d3" status: 200 len: 1357 microversion: 2.1 time: 0.252774 Nov 22 12:23:39.271400 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 482/897] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:23:39 2021] GET /compute/v2.1/servers/131dcb5b-f62d-42ec-b0d0-588a120aa1d3 => generated 1357 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 12:23:39.700381 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-144fda68-1a04-4cad-bbe0-dd99ccbb98d7 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:23:39.701885 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-144fda68-1a04-4cad-bbe0-dd99ccbb98d7 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: 2306113c-8f98-42fd-8c0c-3dfac98fff21] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:23:39.710115 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-144fda68-1a04-4cad-bbe0-dd99ccbb98d7 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:39.711065 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-144fda68-1a04-4cad-bbe0-dd99ccbb98d7 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:39.712185 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-144fda68-1a04-4cad-bbe0-dd99ccbb98d7 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:39.713161 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-144fda68-1a04-4cad-bbe0-dd99ccbb98d7 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:39.898848 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-144fda68-1a04-4cad-bbe0-dd99ccbb98d7 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41d885b9b854d8db11da5d325552301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f5dffe9bc3f41c7a2656d194fd02173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:23:39.911049 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-144fda68-1a04-4cad-bbe0-dd99ccbb98d7 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "GET /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21" status: 200 len: 1723 microversion: 2.1 time: 0.216477 Nov 22 12:23:39.921898 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 416/898] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:23:39 2021] GET /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21 => generated 1723 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:23:40.287322 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-6f2c71bb-5b2c-4b91-9c90-81ccb08d7271 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:23:40.287952 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-6f2c71bb-5b2c-4b91-9c90-81ccb08d7271 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] [instance: 131dcb5b-f62d-42ec-b0d0-588a120aa1d3] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:23:40.295099 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-6f2c71bb-5b2c-4b91-9c90-81ccb08d7271 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:40.295826 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-6f2c71bb-5b2c-4b91-9c90-81ccb08d7271 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:40.296805 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-6f2c71bb-5b2c-4b91-9c90-81ccb08d7271 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:40.297401 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-6f2c71bb-5b2c-4b91-9c90-81ccb08d7271 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:40.461804 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-6f2c71bb-5b2c-4b91-9c90-81ccb08d7271 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc2a99b8e8f244aab8bd6545355ee044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b282b4e5e2147a692e990f45ce44b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:23:40.470458 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-6f2c71bb-5b2c-4b91-9c90-81ccb08d7271 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] 10.222.0.66 "GET /compute/v2.1/servers/131dcb5b-f62d-42ec-b0d0-588a120aa1d3" status: 200 len: 1357 microversion: 2.1 time: 0.185954 Nov 22 12:23:40.471465 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 483/899] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:23:40 2021] GET /compute/v2.1/servers/131dcb5b-f62d-42ec-b0d0-588a120aa1d3 => generated 1357 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:23:40.929363 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-03e112c9-7611-46dc-9211-9ba29ac73206 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:23:40.929984 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-03e112c9-7611-46dc-9211-9ba29ac73206 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: 2306113c-8f98-42fd-8c0c-3dfac98fff21] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:23:40.936933 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-03e112c9-7611-46dc-9211-9ba29ac73206 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:40.937388 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-03e112c9-7611-46dc-9211-9ba29ac73206 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:40.938185 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-03e112c9-7611-46dc-9211-9ba29ac73206 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:40.938621 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-03e112c9-7611-46dc-9211-9ba29ac73206 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:41.073562 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-03e112c9-7611-46dc-9211-9ba29ac73206 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41d885b9b854d8db11da5d325552301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f5dffe9bc3f41c7a2656d194fd02173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:23:41.081967 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-03e112c9-7611-46dc-9211-9ba29ac73206 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "GET /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21" status: 200 len: 1723 microversion: 2.1 time: 0.156295 Nov 22 12:23:41.082803 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 417/900] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:23:40 2021] GET /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:23:41.487806 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-c62d2747-742f-4efa-81e6-76565ef1f9b1 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:23:41.489039 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-c62d2747-742f-4efa-81e6-76565ef1f9b1 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] [instance: 131dcb5b-f62d-42ec-b0d0-588a120aa1d3] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:23:41.495673 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-c62d2747-742f-4efa-81e6-76565ef1f9b1 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:41.496053 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-c62d2747-742f-4efa-81e6-76565ef1f9b1 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:41.496841 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-c62d2747-742f-4efa-81e6-76565ef1f9b1 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:41.497273 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-c62d2747-742f-4efa-81e6-76565ef1f9b1 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:41.645375 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-c62d2747-742f-4efa-81e6-76565ef1f9b1 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc2a99b8e8f244aab8bd6545355ee044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b282b4e5e2147a692e990f45ce44b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:23:41.658522 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-c62d2747-742f-4efa-81e6-76565ef1f9b1 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] 10.222.0.66 "GET /compute/v2.1/servers/131dcb5b-f62d-42ec-b0d0-588a120aa1d3" status: 200 len: 1357 microversion: 2.1 time: 0.174126 Nov 22 12:23:41.659260 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 484/901] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:23:41 2021] GET /compute/v2.1/servers/131dcb5b-f62d-42ec-b0d0-588a120aa1d3 => generated 1357 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:23:42.101649 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-8b8284af-f78f-4f4d-aa29-ab891a17f688 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:23:42.102231 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-8b8284af-f78f-4f4d-aa29-ab891a17f688 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: 2306113c-8f98-42fd-8c0c-3dfac98fff21] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:23:42.108966 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-8b8284af-f78f-4f4d-aa29-ab891a17f688 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:42.109763 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-8b8284af-f78f-4f4d-aa29-ab891a17f688 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:42.110561 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-8b8284af-f78f-4f4d-aa29-ab891a17f688 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:42.110988 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-8b8284af-f78f-4f4d-aa29-ab891a17f688 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:42.289427 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-8b8284af-f78f-4f4d-aa29-ab891a17f688 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41d885b9b854d8db11da5d325552301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f5dffe9bc3f41c7a2656d194fd02173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:23:42.298015 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-8b8284af-f78f-4f4d-aa29-ab891a17f688 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "GET /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21" status: 200 len: 1723 microversion: 2.1 time: 0.200121 Nov 22 12:23:42.298608 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 418/902] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:23:42 2021] GET /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21 => generated 1723 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:23:42.677040 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-16abf182-8c17-4d56-937b-9399b8d2d5ad tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:23:42.677934 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-16abf182-8c17-4d56-937b-9399b8d2d5ad tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] [instance: 131dcb5b-f62d-42ec-b0d0-588a120aa1d3] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:23:42.687886 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-16abf182-8c17-4d56-937b-9399b8d2d5ad tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:42.689389 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-16abf182-8c17-4d56-937b-9399b8d2d5ad tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:42.690460 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-16abf182-8c17-4d56-937b-9399b8d2d5ad tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:42.691111 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-16abf182-8c17-4d56-937b-9399b8d2d5ad tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:42.877730 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-16abf182-8c17-4d56-937b-9399b8d2d5ad tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc2a99b8e8f244aab8bd6545355ee044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b282b4e5e2147a692e990f45ce44b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:23:42.891867 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-16abf182-8c17-4d56-937b-9399b8d2d5ad tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] 10.222.0.66 "GET /compute/v2.1/servers/131dcb5b-f62d-42ec-b0d0-588a120aa1d3" status: 200 len: 1357 microversion: 2.1 time: 0.219599 Nov 22 12:23:42.892880 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 485/903] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:23:42 2021] GET /compute/v2.1/servers/131dcb5b-f62d-42ec-b0d0-588a120aa1d3 => generated 1357 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:23:43.315975 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-bf16e880-7d42-49d3-b970-4c35694080b8 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:23:43.316704 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-bf16e880-7d42-49d3-b970-4c35694080b8 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: 2306113c-8f98-42fd-8c0c-3dfac98fff21] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:23:43.323754 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-bf16e880-7d42-49d3-b970-4c35694080b8 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:43.324206 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-bf16e880-7d42-49d3-b970-4c35694080b8 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:43.324988 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-bf16e880-7d42-49d3-b970-4c35694080b8 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:43.325522 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-bf16e880-7d42-49d3-b970-4c35694080b8 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:43.707409 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-bf16e880-7d42-49d3-b970-4c35694080b8 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41d885b9b854d8db11da5d325552301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f5dffe9bc3f41c7a2656d194fd02173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:23:43.717214 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-bf16e880-7d42-49d3-b970-4c35694080b8 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "GET /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21" status: 200 len: 1723 microversion: 2.1 time: 0.405180 Nov 22 12:23:43.717771 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 419/904] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:23:43 2021] GET /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21 => generated 1723 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:23:43.910471 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-9fb05963-85b2-4a85-9c5f-98cae59cf8da tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:23:43.911126 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-9fb05963-85b2-4a85-9c5f-98cae59cf8da tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] [instance: 131dcb5b-f62d-42ec-b0d0-588a120aa1d3] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:23:43.918287 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-9fb05963-85b2-4a85-9c5f-98cae59cf8da tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:43.918733 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-9fb05963-85b2-4a85-9c5f-98cae59cf8da tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:43.919548 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-9fb05963-85b2-4a85-9c5f-98cae59cf8da tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:43.919985 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-9fb05963-85b2-4a85-9c5f-98cae59cf8da tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:44.054475 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-9fb05963-85b2-4a85-9c5f-98cae59cf8da tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc2a99b8e8f244aab8bd6545355ee044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b282b4e5e2147a692e990f45ce44b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:23:44.061857 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-9fb05963-85b2-4a85-9c5f-98cae59cf8da tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] 10.222.0.66 "GET /compute/v2.1/servers/131dcb5b-f62d-42ec-b0d0-588a120aa1d3" status: 200 len: 1357 microversion: 2.1 time: 0.155058 Nov 22 12:23:44.062422 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 486/905] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:23:43 2021] GET /compute/v2.1/servers/131dcb5b-f62d-42ec-b0d0-588a120aa1d3 => generated 1357 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:23:44.736344 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-e9c650be-a824-479d-84f8-b818cf1b799f tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:23:44.737182 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-e9c650be-a824-479d-84f8-b818cf1b799f tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: 2306113c-8f98-42fd-8c0c-3dfac98fff21] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:23:44.744851 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-e9c650be-a824-479d-84f8-b818cf1b799f tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:44.745310 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-e9c650be-a824-479d-84f8-b818cf1b799f tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:44.746392 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-e9c650be-a824-479d-84f8-b818cf1b799f tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:44.746824 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-e9c650be-a824-479d-84f8-b818cf1b799f tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:45.017092 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-e9c650be-a824-479d-84f8-b818cf1b799f tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41d885b9b854d8db11da5d325552301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f5dffe9bc3f41c7a2656d194fd02173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:23:45.044895 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-e9c650be-a824-479d-84f8-b818cf1b799f tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "GET /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21" status: 200 len: 1723 microversion: 2.1 time: 0.312456 Nov 22 12:23:45.054750 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 420/906] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:23:44 2021] GET /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21 => generated 1723 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:23:45.093777 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-324896f0-0a4a-481c-9bdf-d0d3b9539885 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:23:45.096606 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-324896f0-0a4a-481c-9bdf-d0d3b9539885 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] [instance: 131dcb5b-f62d-42ec-b0d0-588a120aa1d3] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:23:45.138789 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-324896f0-0a4a-481c-9bdf-d0d3b9539885 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:45.138789 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-324896f0-0a4a-481c-9bdf-d0d3b9539885 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:45.149977 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-324896f0-0a4a-481c-9bdf-d0d3b9539885 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:45.151451 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-324896f0-0a4a-481c-9bdf-d0d3b9539885 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:45.366334 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-324896f0-0a4a-481c-9bdf-d0d3b9539885 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc2a99b8e8f244aab8bd6545355ee044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b282b4e5e2147a692e990f45ce44b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:23:45.374681 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-324896f0-0a4a-481c-9bdf-d0d3b9539885 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] 10.222.0.66 "GET /compute/v2.1/servers/131dcb5b-f62d-42ec-b0d0-588a120aa1d3" status: 200 len: 1357 microversion: 2.1 time: 0.298969 Nov 22 12:23:45.375312 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 487/907] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:23:45 2021] GET /compute/v2.1/servers/131dcb5b-f62d-42ec-b0d0-588a120aa1d3 => generated 1357 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:23:46.082360 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-f5a0e3ac-2c67-4a63-8842-18a6ac219a54 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:23:46.082360 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-f5a0e3ac-2c67-4a63-8842-18a6ac219a54 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: 2306113c-8f98-42fd-8c0c-3dfac98fff21] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:23:46.088629 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-f5a0e3ac-2c67-4a63-8842-18a6ac219a54 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:46.089305 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-f5a0e3ac-2c67-4a63-8842-18a6ac219a54 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:46.090107 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-f5a0e3ac-2c67-4a63-8842-18a6ac219a54 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:46.090535 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-f5a0e3ac-2c67-4a63-8842-18a6ac219a54 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:46.289518 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-f5a0e3ac-2c67-4a63-8842-18a6ac219a54 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41d885b9b854d8db11da5d325552301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f5dffe9bc3f41c7a2656d194fd02173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:23:46.298983 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-f5a0e3ac-2c67-4a63-8842-18a6ac219a54 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "GET /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21" status: 200 len: 1723 microversion: 2.1 time: 0.221865 Nov 22 12:23:46.307802 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 421/908] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:23:46 2021] GET /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21 => generated 1723 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:23:46.392164 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-94709bb9-f597-43dc-bfa8-58ddc0823f93 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:23:46.392860 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-94709bb9-f597-43dc-bfa8-58ddc0823f93 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] [instance: 131dcb5b-f62d-42ec-b0d0-588a120aa1d3] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:23:46.399392 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-94709bb9-f597-43dc-bfa8-58ddc0823f93 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:46.399841 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-94709bb9-f597-43dc-bfa8-58ddc0823f93 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:46.400639 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-94709bb9-f597-43dc-bfa8-58ddc0823f93 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:46.401065 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-94709bb9-f597-43dc-bfa8-58ddc0823f93 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:46.552391 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-94709bb9-f597-43dc-bfa8-58ddc0823f93 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc2a99b8e8f244aab8bd6545355ee044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b282b4e5e2147a692e990f45ce44b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:23:46.560321 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-94709bb9-f597-43dc-bfa8-58ddc0823f93 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] 10.222.0.66 "GET /compute/v2.1/servers/131dcb5b-f62d-42ec-b0d0-588a120aa1d3" status: 200 len: 1357 microversion: 2.1 time: 0.171973 Nov 22 12:23:46.561222 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 488/909] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:23:46 2021] GET /compute/v2.1/servers/131dcb5b-f62d-42ec-b0d0-588a120aa1d3 => generated 1357 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:23:46.906874 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [req-5b19e2a3-f2ca-40b3-86f9-b79e0d202836 req-710b5552-4f69-4b84-910f-ce931b962fb4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "131dcb5b-f62d-42ec-b0d0-588a120aa1d3", "name": "network-vif-plugged", "status": "completed", "tag": "f7e46359-fc84-431c-88fd-b6af0c318ee6"}]} {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:23:46.908689 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 12:23:46.908689 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: warnings.warn(msg) Nov 22 12:23:46.917521 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [req-5b19e2a3-f2ca-40b3-86f9-b79e0d202836 req-710b5552-4f69-4b84-910f-ce931b962fb4 service nova] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:46.918122 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [req-5b19e2a3-f2ca-40b3-86f9-b79e0d202836 req-710b5552-4f69-4b84-910f-ce931b962fb4 service nova] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:46.930615 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.compute.server_external_events [req-5b19e2a3-f2ca-40b3-86f9-b79e0d202836 req-710b5552-4f69-4b84-910f-ce931b962fb4 service nova] Creating event network-vif-plugged:f7e46359-fc84-431c-88fd-b6af0c318ee6 for instance 131dcb5b-f62d-42ec-b0d0-588a120aa1d3 on hv-cinder-76845 Nov 22 12:23:46.946414 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [req-5b19e2a3-f2ca-40b3-86f9-b79e0d202836 req-710b5552-4f69-4b84-910f-ce931b962fb4 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043190 Nov 22 12:23:46.956187 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 422/910] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Nov 22 12:23:46 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 12:23:47.316437 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-8f22ee7a-1b0b-42c5-8a15-4e823131c7d0 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:23:47.317401 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-8f22ee7a-1b0b-42c5-8a15-4e823131c7d0 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: 2306113c-8f98-42fd-8c0c-3dfac98fff21] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:23:47.329259 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-8f22ee7a-1b0b-42c5-8a15-4e823131c7d0 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:47.330330 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-8f22ee7a-1b0b-42c5-8a15-4e823131c7d0 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:47.333439 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-8f22ee7a-1b0b-42c5-8a15-4e823131c7d0 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:47.333439 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-8f22ee7a-1b0b-42c5-8a15-4e823131c7d0 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:47.529244 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-8f22ee7a-1b0b-42c5-8a15-4e823131c7d0 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41d885b9b854d8db11da5d325552301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f5dffe9bc3f41c7a2656d194fd02173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:23:47.539606 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-8f22ee7a-1b0b-42c5-8a15-4e823131c7d0 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "GET /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21" status: 200 len: 1723 microversion: 2.1 time: 0.226999 Nov 22 12:23:47.540773 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 489/911] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:23:47 2021] GET /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21 => generated 1723 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:23:47.579837 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-0d51861c-667d-4e6a-89e1-9cd054acd94a tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:23:47.580714 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-0d51861c-667d-4e6a-89e1-9cd054acd94a tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] [instance: 131dcb5b-f62d-42ec-b0d0-588a120aa1d3] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:23:47.588700 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-0d51861c-667d-4e6a-89e1-9cd054acd94a tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:47.588700 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-0d51861c-667d-4e6a-89e1-9cd054acd94a tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:47.589055 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-0d51861c-667d-4e6a-89e1-9cd054acd94a tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:47.589458 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-0d51861c-667d-4e6a-89e1-9cd054acd94a tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:47.733747 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-0d51861c-667d-4e6a-89e1-9cd054acd94a tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc2a99b8e8f244aab8bd6545355ee044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b282b4e5e2147a692e990f45ce44b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:23:47.742420 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-0d51861c-667d-4e6a-89e1-9cd054acd94a tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] 10.222.0.66 "GET /compute/v2.1/servers/131dcb5b-f62d-42ec-b0d0-588a120aa1d3" status: 200 len: 1357 microversion: 2.1 time: 0.167374 Nov 22 12:23:47.743566 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 423/912] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:23:47 2021] GET /compute/v2.1/servers/131dcb5b-f62d-42ec-b0d0-588a120aa1d3 => generated 1357 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:23:48.557120 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-b8302359-4e73-4f1e-b402-f8a12ce65279 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:23:48.559459 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-b8302359-4e73-4f1e-b402-f8a12ce65279 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: 2306113c-8f98-42fd-8c0c-3dfac98fff21] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:23:48.568909 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-b8302359-4e73-4f1e-b402-f8a12ce65279 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:48.569663 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-b8302359-4e73-4f1e-b402-f8a12ce65279 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:48.570828 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-b8302359-4e73-4f1e-b402-f8a12ce65279 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:48.571375 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-b8302359-4e73-4f1e-b402-f8a12ce65279 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:48.739107 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-b8302359-4e73-4f1e-b402-f8a12ce65279 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41d885b9b854d8db11da5d325552301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f5dffe9bc3f41c7a2656d194fd02173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:23:48.748437 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-b8302359-4e73-4f1e-b402-f8a12ce65279 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "GET /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21" status: 200 len: 1723 microversion: 2.1 time: 0.195171 Nov 22 12:23:48.749041 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 490/913] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:23:48 2021] GET /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21 => generated 1723 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:23:48.760277 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-622317f9-88c3-4ce1-8527-16dc656600b1 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:23:48.761849 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-622317f9-88c3-4ce1-8527-16dc656600b1 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] [instance: 131dcb5b-f62d-42ec-b0d0-588a120aa1d3] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:23:48.768580 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-622317f9-88c3-4ce1-8527-16dc656600b1 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:48.769195 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-622317f9-88c3-4ce1-8527-16dc656600b1 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:48.770253 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-622317f9-88c3-4ce1-8527-16dc656600b1 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:48.770841 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-622317f9-88c3-4ce1-8527-16dc656600b1 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:48.947028 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-622317f9-88c3-4ce1-8527-16dc656600b1 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc2a99b8e8f244aab8bd6545355ee044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b282b4e5e2147a692e990f45ce44b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:23:48.955063 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-622317f9-88c3-4ce1-8527-16dc656600b1 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] 10.222.0.66 "GET /compute/v2.1/servers/131dcb5b-f62d-42ec-b0d0-588a120aa1d3" status: 200 len: 1548 microversion: 2.1 time: 0.198510 Nov 22 12:23:48.955848 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 424/914] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:23:48 2021] GET /compute/v2.1/servers/131dcb5b-f62d-42ec-b0d0-588a120aa1d3 => generated 1548 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:23:48.973754 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-2b9f8b77-a5e5-435d-a633-43bb1c6bb62e tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:23:48.974369 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-2b9f8b77-a5e5-435d-a633-43bb1c6bb62e tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] [instance: 131dcb5b-f62d-42ec-b0d0-588a120aa1d3] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:23:48.980756 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-2b9f8b77-a5e5-435d-a633-43bb1c6bb62e tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:48.981211 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-2b9f8b77-a5e5-435d-a633-43bb1c6bb62e tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:48.982216 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-2b9f8b77-a5e5-435d-a633-43bb1c6bb62e tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:48.982648 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-2b9f8b77-a5e5-435d-a633-43bb1c6bb62e tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:49.136978 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-2b9f8b77-a5e5-435d-a633-43bb1c6bb62e tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc2a99b8e8f244aab8bd6545355ee044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b282b4e5e2147a692e990f45ce44b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:23:49.146701 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-2b9f8b77-a5e5-435d-a633-43bb1c6bb62e tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] 10.222.0.66 "GET /compute/v2.1/servers/131dcb5b-f62d-42ec-b0d0-588a120aa1d3" status: 200 len: 1548 microversion: 2.1 time: 0.177076 Nov 22 12:23:49.147329 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 491/915] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:23:48 2021] GET /compute/v2.1/servers/131dcb5b-f62d-42ec-b0d0-588a120aa1d3 => generated 1548 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:23:49.162981 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-d63a53ac-212e-4080-b79b-b86e5ec5a401 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:23:49.166603 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 12:23:49.166603 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: warnings.warn(msg) Nov 22 12:23:49.167626 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-d63a53ac-212e-4080-b79b-b86e5ec5a401 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fc2a99b8e8f244aab8bd6545355ee044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b282b4e5e2147a692e990f45ce44b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:23:49.168376 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-d63a53ac-212e-4080-b79b-b86e5ec5a401 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Searching by: {'deleted': False, 'project_id': '7b282b4e5e2147a692e990f45ce44b8f'} {{(pid=116273) get_all /opt/stack/nova/nova/compute/api.py:2907}} Nov 22 12:23:49.175285 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-d63a53ac-212e-4080-b79b-b86e5ec5a401 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:49.175723 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-d63a53ac-212e-4080-b79b-b86e5ec5a401 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:49.176515 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-d63a53ac-212e-4080-b79b-b86e5ec5a401 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:49.176937 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-d63a53ac-212e-4080-b79b-b86e5ec5a401 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:49.273870 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.multi_cell_list [None req-d63a53ac-212e-4080-b79b-b86e5ec5a401 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=116273) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 22 12:23:49.374186 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-d63a53ac-212e-4080-b79b-b86e5ec5a401 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] 10.222.0.66 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.214715 Nov 22 12:23:49.374759 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 425/916] 10.222.0.66 () {58 vars in 1124 bytes} [Mon Nov 22 12:23:49 2021] GET /compute/v2.1/servers => generated 342 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 12:23:49.385387 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-cbdd3a51-cf6e-4e66-a651-4aab1161f819 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:23:49.385986 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-cbdd3a51-cf6e-4e66-a651-4aab1161f819 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] [instance: 131dcb5b-f62d-42ec-b0d0-588a120aa1d3] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:23:49.392720 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-cbdd3a51-cf6e-4e66-a651-4aab1161f819 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:49.393193 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-cbdd3a51-cf6e-4e66-a651-4aab1161f819 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:49.393960 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-cbdd3a51-cf6e-4e66-a651-4aab1161f819 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:49.394385 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-cbdd3a51-cf6e-4e66-a651-4aab1161f819 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:49.530675 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-cbdd3a51-cf6e-4e66-a651-4aab1161f819 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc2a99b8e8f244aab8bd6545355ee044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b282b4e5e2147a692e990f45ce44b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:23:49.538663 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-cbdd3a51-cf6e-4e66-a651-4aab1161f819 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] 10.222.0.66 "GET /compute/v2.1/servers/131dcb5b-f62d-42ec-b0d0-588a120aa1d3" status: 200 len: 1548 microversion: 2.1 time: 0.157033 Nov 22 12:23:49.539347 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 492/917] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:23:49 2021] GET /compute/v2.1/servers/131dcb5b-f62d-42ec-b0d0-588a120aa1d3 => generated 1548 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:23:49.771090 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-590d2f22-c1cf-4bcf-b4bc-349065460aa2 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:23:49.771982 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-590d2f22-c1cf-4bcf-b4bc-349065460aa2 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: 2306113c-8f98-42fd-8c0c-3dfac98fff21] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:23:49.780214 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-590d2f22-c1cf-4bcf-b4bc-349065460aa2 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:49.780658 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-590d2f22-c1cf-4bcf-b4bc-349065460aa2 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:49.793427 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-590d2f22-c1cf-4bcf-b4bc-349065460aa2 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:49.794078 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-590d2f22-c1cf-4bcf-b4bc-349065460aa2 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:49.979425 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-590d2f22-c1cf-4bcf-b4bc-349065460aa2 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41d885b9b854d8db11da5d325552301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f5dffe9bc3f41c7a2656d194fd02173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:23:49.987968 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-590d2f22-c1cf-4bcf-b4bc-349065460aa2 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "GET /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21" status: 200 len: 1723 microversion: 2.1 time: 0.220427 Nov 22 12:23:49.988598 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 426/918] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:23:49 2021] GET /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21 => generated 1723 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 12:23:51.006070 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-35a0b3f5-7fac-4805-9ecb-8492a2b34919 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:23:51.006676 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-35a0b3f5-7fac-4805-9ecb-8492a2b34919 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: 2306113c-8f98-42fd-8c0c-3dfac98fff21] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:23:51.014278 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-35a0b3f5-7fac-4805-9ecb-8492a2b34919 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:51.014785 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-35a0b3f5-7fac-4805-9ecb-8492a2b34919 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:51.015509 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-35a0b3f5-7fac-4805-9ecb-8492a2b34919 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:51.016107 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-35a0b3f5-7fac-4805-9ecb-8492a2b34919 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:51.105151 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-0b8bd550-58ec-4e8d-a189-94c6620f2865 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c38a2195-0d58-4131-9e72-de7f25458c99"}} {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:23:51.107317 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-0b8bd550-58ec-4e8d-a189-94c6620f2865 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] [instance: 131dcb5b-f62d-42ec-b0d0-588a120aa1d3] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:23:51.117030 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-0b8bd550-58ec-4e8d-a189-94c6620f2865 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:51.118466 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-0b8bd550-58ec-4e8d-a189-94c6620f2865 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:51.119669 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-0b8bd550-58ec-4e8d-a189-94c6620f2865 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:51.120395 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-0b8bd550-58ec-4e8d-a189-94c6620f2865 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:51.185069 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-35a0b3f5-7fac-4805-9ecb-8492a2b34919 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41d885b9b854d8db11da5d325552301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f5dffe9bc3f41c7a2656d194fd02173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:23:51.194649 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-35a0b3f5-7fac-4805-9ecb-8492a2b34919 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "GET /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21" status: 200 len: 1723 microversion: 2.1 time: 0.192091 Nov 22 12:23:51.195997 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 493/919] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:23:51 2021] GET /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21 => generated 1723 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:23:51.429458 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-0b8bd550-58ec-4e8d-a189-94c6620f2865 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] 10.222.0.66 "POST /compute/v2.1/servers/131dcb5b-f62d-42ec-b0d0-588a120aa1d3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.329145 Nov 22 12:23:51.430219 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 427/920] 10.222.0.66 () {60 vars in 1322 bytes} [Mon Nov 22 12:23:51 2021] POST /compute/v2.1/servers/131dcb5b-f62d-42ec-b0d0-588a120aa1d3/os-volume_attachments => generated 194 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 12:23:52.212312 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-dc8dce27-baab-4827-85d1-0345c28b89f8 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:23:52.212921 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-dc8dce27-baab-4827-85d1-0345c28b89f8 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: 2306113c-8f98-42fd-8c0c-3dfac98fff21] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:23:52.221505 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-dc8dce27-baab-4827-85d1-0345c28b89f8 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:52.222033 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-dc8dce27-baab-4827-85d1-0345c28b89f8 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:52.223807 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-dc8dce27-baab-4827-85d1-0345c28b89f8 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:52.224432 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-dc8dce27-baab-4827-85d1-0345c28b89f8 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:52.365001 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-dc8dce27-baab-4827-85d1-0345c28b89f8 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41d885b9b854d8db11da5d325552301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f5dffe9bc3f41c7a2656d194fd02173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:23:52.374764 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-dc8dce27-baab-4827-85d1-0345c28b89f8 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "GET /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21" status: 200 len: 1700 microversion: 2.1 time: 0.166092 Nov 22 12:23:52.375462 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 494/921] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:23:52 2021] GET /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21 => generated 1700 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 12:23:52.392877 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-1a8e451a-aa38-46f9-9dff-14efe2e622ca tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:23:52.400334 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-1a8e451a-aa38-46f9-9dff-14efe2e622ca tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:52.400893 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-1a8e451a-aa38-46f9-9dff-14efe2e622ca tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:52.424397 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-1a8e451a-aa38-46f9-9dff-14efe2e622ca tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: 2306113c-8f98-42fd-8c0c-3dfac98fff21] Going to try to start instance {{(pid=116273) start /opt/stack/nova/nova/compute/api.py:2677}} Nov 22 12:23:52.479170 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-1a8e451a-aa38-46f9-9dff-14efe2e622ca tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "POST /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21/action" status: 202 len: 0 microversion: 2.1 time: 0.090145 Nov 22 12:23:52.480136 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 428/922] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Nov 22 12:23:52 2021] POST /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21/action => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 22 12:23:52.496215 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-43273a0f-8f65-4968-9de1-c9279205507e tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:23:52.497287 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-43273a0f-8f65-4968-9de1-c9279205507e tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: 2306113c-8f98-42fd-8c0c-3dfac98fff21] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:23:52.510691 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-43273a0f-8f65-4968-9de1-c9279205507e tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:52.511412 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-43273a0f-8f65-4968-9de1-c9279205507e tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:52.512566 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-43273a0f-8f65-4968-9de1-c9279205507e tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:52.513175 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-43273a0f-8f65-4968-9de1-c9279205507e tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:52.735173 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-43273a0f-8f65-4968-9de1-c9279205507e tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41d885b9b854d8db11da5d325552301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f5dffe9bc3f41c7a2656d194fd02173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:23:52.743917 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-43273a0f-8f65-4968-9de1-c9279205507e tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "GET /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21" status: 200 len: 1709 microversion: 2.1 time: 0.254579 Nov 22 12:23:52.745368 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 495/923] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:23:52 2021] GET /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21 => generated 1709 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:23:53.771740 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-4c47c18d-8097-42d1-9947-6bd2adb3d2ed tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:23:53.771740 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-4c47c18d-8097-42d1-9947-6bd2adb3d2ed tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: 2306113c-8f98-42fd-8c0c-3dfac98fff21] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:23:53.787741 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-4c47c18d-8097-42d1-9947-6bd2adb3d2ed tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:53.788194 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-4c47c18d-8097-42d1-9947-6bd2adb3d2ed tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:53.789091 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-4c47c18d-8097-42d1-9947-6bd2adb3d2ed tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:53.789535 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-4c47c18d-8097-42d1-9947-6bd2adb3d2ed tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:54.081405 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-4c47c18d-8097-42d1-9947-6bd2adb3d2ed tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41d885b9b854d8db11da5d325552301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f5dffe9bc3f41c7a2656d194fd02173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:23:54.102994 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-4c47c18d-8097-42d1-9947-6bd2adb3d2ed tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "GET /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21" status: 200 len: 1709 microversion: 2.1 time: 0.343926 Nov 22 12:23:54.109946 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 429/924] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:23:53 2021] GET /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21 => generated 1709 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:23:55.127554 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-8dfab0bc-c10b-45ff-841c-6be16daa6746 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:23:55.129050 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-8dfab0bc-c10b-45ff-841c-6be16daa6746 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: 2306113c-8f98-42fd-8c0c-3dfac98fff21] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:23:55.136345 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-8dfab0bc-c10b-45ff-841c-6be16daa6746 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:55.136796 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-8dfab0bc-c10b-45ff-841c-6be16daa6746 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:55.137631 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-8dfab0bc-c10b-45ff-841c-6be16daa6746 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:55.138055 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-8dfab0bc-c10b-45ff-841c-6be16daa6746 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:55.289857 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-8dfab0bc-c10b-45ff-841c-6be16daa6746 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41d885b9b854d8db11da5d325552301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f5dffe9bc3f41c7a2656d194fd02173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:23:55.298633 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-8dfab0bc-c10b-45ff-841c-6be16daa6746 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "GET /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21" status: 200 len: 1713 microversion: 2.1 time: 0.175031 Nov 22 12:23:55.308586 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 496/925] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:23:55 2021] GET /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21 => generated 1713 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 12:23:59.026688 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-3ddc42a0-3ca3-46fb-8757-daf4d46c0b80 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:23:59.027329 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-3ddc42a0-3ca3-46fb-8757-daf4d46c0b80 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] [instance: 131dcb5b-f62d-42ec-b0d0-588a120aa1d3] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:23:59.033943 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-3ddc42a0-3ca3-46fb-8757-daf4d46c0b80 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:59.034396 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-3ddc42a0-3ca3-46fb-8757-daf4d46c0b80 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:59.035183 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-3ddc42a0-3ca3-46fb-8757-daf4d46c0b80 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:23:59.035649 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-3ddc42a0-3ca3-46fb-8757-daf4d46c0b80 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:23:59.170846 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-3ddc42a0-3ca3-46fb-8757-daf4d46c0b80 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc2a99b8e8f244aab8bd6545355ee044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b282b4e5e2147a692e990f45ce44b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:23:59.179652 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-3ddc42a0-3ca3-46fb-8757-daf4d46c0b80 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] 10.222.0.66 "GET /compute/v2.1/servers/131dcb5b-f62d-42ec-b0d0-588a120aa1d3" status: 200 len: 1594 microversion: 2.1 time: 0.156063 Nov 22 12:23:59.180383 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 430/926] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:23:59 2021] GET /compute/v2.1/servers/131dcb5b-f62d-42ec-b0d0-588a120aa1d3 => generated 1594 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:24:01.256032 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [req-747daaf8-fda0-4631-98e1-35f4dac33594 req-dac19bd2-61e3-47b1-8ee1-a759662d07d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "131dcb5b-f62d-42ec-b0d0-588a120aa1d3", "tag": "f7e46359-fc84-431c-88fd-b6af0c318ee6"}]} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:24:01.258358 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 12:24:01.258358 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: warnings.warn(msg) Nov 22 12:24:01.265976 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [req-747daaf8-fda0-4631-98e1-35f4dac33594 req-dac19bd2-61e3-47b1-8ee1-a759662d07d2 service nova] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:24:01.266522 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [req-747daaf8-fda0-4631-98e1-35f4dac33594 req-dac19bd2-61e3-47b1-8ee1-a759662d07d2 service nova] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:24:01.279548 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.compute.server_external_events [req-747daaf8-fda0-4631-98e1-35f4dac33594 req-dac19bd2-61e3-47b1-8ee1-a759662d07d2 service nova] Creating event network-changed:f7e46359-fc84-431c-88fd-b6af0c318ee6 for instance 131dcb5b-f62d-42ec-b0d0-588a120aa1d3 on hv-cinder-76845 Nov 22 12:24:01.284798 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [req-747daaf8-fda0-4631-98e1-35f4dac33594 req-dac19bd2-61e3-47b1-8ee1-a759662d07d2 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032640 Nov 22 12:24:01.285820 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 497/927] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Nov 22 12:24:01 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 12:24:02.451011 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-ec9835fe-4672-4990-8829-7e22f31ec08c tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-271807768"}} {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:24:02.451577 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-ec9835fe-4672-4990-8829-7e22f31ec08c tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] [instance: 131dcb5b-f62d-42ec-b0d0-588a120aa1d3] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:24:02.458289 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-ec9835fe-4672-4990-8829-7e22f31ec08c tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:24:02.459008 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-ec9835fe-4672-4990-8829-7e22f31ec08c tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:24:02.460371 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-ec9835fe-4672-4990-8829-7e22f31ec08c tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:24:02.460709 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-ec9835fe-4672-4990-8829-7e22f31ec08c tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:24:02.591561 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.network.security_group_api [None req-ec9835fe-4672-4990-8829-7e22f31ec08c tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Adding security group 6bde9ed8-9c6b-4c28-ae4a-506b5d391ae6 to port f7e46359-fc84-431c-88fd-b6af0c318ee6 Nov 22 12:24:02.971073 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-ec9835fe-4672-4990-8829-7e22f31ec08c tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] 10.222.0.66 "POST /compute/v2.1/servers/131dcb5b-f62d-42ec-b0d0-588a120aa1d3/action" status: 202 len: 0 microversion: 2.1 time: 0.523774 Nov 22 12:24:02.974991 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 431/928] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Nov 22 12:24:02 2021] POST /compute/v2.1/servers/131dcb5b-f62d-42ec-b0d0-588a120aa1d3/action => generated 0 bytes in 525 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 22 12:24:02.981089 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-e4533a40-aeb3-4fa4-9f61-cdc6d0cdd997 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:24:02.981769 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-e4533a40-aeb3-4fa4-9f61-cdc6d0cdd997 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] [instance: 131dcb5b-f62d-42ec-b0d0-588a120aa1d3] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:24:02.989438 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-e4533a40-aeb3-4fa4-9f61-cdc6d0cdd997 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:24:02.989843 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-e4533a40-aeb3-4fa4-9f61-cdc6d0cdd997 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:24:02.991064 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-e4533a40-aeb3-4fa4-9f61-cdc6d0cdd997 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:24:02.991989 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-e4533a40-aeb3-4fa4-9f61-cdc6d0cdd997 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:24:03.192855 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-e4533a40-aeb3-4fa4-9f61-cdc6d0cdd997 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc2a99b8e8f244aab8bd6545355ee044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b282b4e5e2147a692e990f45ce44b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:24:03.201618 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-e4533a40-aeb3-4fa4-9f61-cdc6d0cdd997 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] 10.222.0.66 "GET /compute/v2.1/servers/131dcb5b-f62d-42ec-b0d0-588a120aa1d3" status: 200 len: 1758 microversion: 2.1 time: 0.224983 Nov 22 12:24:03.202319 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 498/929] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:24:02 2021] GET /compute/v2.1/servers/131dcb5b-f62d-42ec-b0d0-588a120aa1d3 => generated 1758 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:24:03.304001 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [req-6867b07f-b720-4ea1-9b8b-5212b78cf769 req-7473670c-6e82-4938-b3c2-d6d414dbdd61 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "131dcb5b-f62d-42ec-b0d0-588a120aa1d3", "tag": "f7e46359-fc84-431c-88fd-b6af0c318ee6"}]} {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:24:03.306489 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 12:24:03.306489 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: warnings.warn(msg) Nov 22 12:24:03.315165 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [req-6867b07f-b720-4ea1-9b8b-5212b78cf769 req-7473670c-6e82-4938-b3c2-d6d414dbdd61 service nova] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:24:03.318150 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [req-6867b07f-b720-4ea1-9b8b-5212b78cf769 req-7473670c-6e82-4938-b3c2-d6d414dbdd61 service nova] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:24:03.337958 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.compute.server_external_events [req-6867b07f-b720-4ea1-9b8b-5212b78cf769 req-7473670c-6e82-4938-b3c2-d6d414dbdd61 service nova] Creating event network-changed:f7e46359-fc84-431c-88fd-b6af0c318ee6 for instance 131dcb5b-f62d-42ec-b0d0-588a120aa1d3 on hv-cinder-76845 Nov 22 12:24:03.344854 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [req-6867b07f-b720-4ea1-9b8b-5212b78cf769 req-7473670c-6e82-4938-b3c2-d6d414dbdd61 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045923 Nov 22 12:24:03.351706 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 432/930] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Nov 22 12:24:03 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 12:24:04.109939 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-291770c3-2aeb-4aab-a6f5-6939d7e71f59 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:24:04.110498 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-291770c3-2aeb-4aab-a6f5-6939d7e71f59 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: c9f6d441-246f-479e-8e88-ea701c0f87ff] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:24:04.117439 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-291770c3-2aeb-4aab-a6f5-6939d7e71f59 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:24:04.117928 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-291770c3-2aeb-4aab-a6f5-6939d7e71f59 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:24:04.118722 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-291770c3-2aeb-4aab-a6f5-6939d7e71f59 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:24:04.119147 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-291770c3-2aeb-4aab-a6f5-6939d7e71f59 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:24:04.150063 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-291770c3-2aeb-4aab-a6f5-6939d7e71f59 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff/os-volume_attachments/db96e63f-64c8-4e78-8a77-3670f5400a39" status: 200 len: 194 microversion: 2.20 time: 0.043956 Nov 22 12:24:04.150640 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 499/931] 10.222.0.66 () {60 vars in 1453 bytes} [Mon Nov 22 12:24:04 2021] GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff/os-volume_attachments/db96e63f-64c8-4e78-8a77-3670f5400a39 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 12:24:04.218591 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-3227c22d-08da-46b1-863d-e32a04ac006c tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:24:04.219113 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-3227c22d-08da-46b1-863d-e32a04ac006c tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: c9f6d441-246f-479e-8e88-ea701c0f87ff] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:24:04.226317 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-3227c22d-08da-46b1-863d-e32a04ac006c tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:24:04.226792 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-3227c22d-08da-46b1-863d-e32a04ac006c tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:24:04.227697 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-3227c22d-08da-46b1-863d-e32a04ac006c tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:24:04.228131 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-3227c22d-08da-46b1-863d-e32a04ac006c tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:24:04.313274 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.objects.instance [None req-3227c22d-08da-46b1-863d-e32a04ac006c tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lazy-loading 'services' on Instance uuid c9f6d441-246f-479e-8e88-ea701c0f87ff {{(pid=116273) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 22 12:24:04.391947 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-3227c22d-08da-46b1-863d-e32a04ac006c tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "DELETE /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff/os-volume_attachments/db96e63f-64c8-4e78-8a77-3670f5400a39" status: 202 len: 0 microversion: 2.20 time: 0.177871 Nov 22 12:24:04.392545 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 433/932] 10.222.0.66 () {60 vars in 1456 bytes} [Mon Nov 22 12:24:04 2021] DELETE /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff/os-volume_attachments/db96e63f-64c8-4e78-8a77-3670f5400a39 => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 22 12:24:04.401664 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-45c9c183-38dd-46b4-af5c-ec17a9a3e9e9 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:24:04.402675 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-45c9c183-38dd-46b4-af5c-ec17a9a3e9e9 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: c9f6d441-246f-479e-8e88-ea701c0f87ff] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:24:04.409700 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-45c9c183-38dd-46b4-af5c-ec17a9a3e9e9 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:24:04.410171 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-45c9c183-38dd-46b4-af5c-ec17a9a3e9e9 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:24:04.410981 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-45c9c183-38dd-46b4-af5c-ec17a9a3e9e9 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:24:04.411461 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-45c9c183-38dd-46b4-af5c-ec17a9a3e9e9 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:24:04.445026 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-45c9c183-38dd-46b4-af5c-ec17a9a3e9e9 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047017 Nov 22 12:24:04.445752 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 500/933] 10.222.0.66 () {60 vars in 1342 bytes} [Mon Nov 22 12:24:04 2021] GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 22 12:24:05.461524 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-2628dc35-7b95-4836-a5e9-7b7e75615d71 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:24:05.462438 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-2628dc35-7b95-4836-a5e9-7b7e75615d71 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: c9f6d441-246f-479e-8e88-ea701c0f87ff] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:24:05.469525 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-2628dc35-7b95-4836-a5e9-7b7e75615d71 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:24:05.470011 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-2628dc35-7b95-4836-a5e9-7b7e75615d71 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:24:05.470839 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-2628dc35-7b95-4836-a5e9-7b7e75615d71 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:24:05.471288 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-2628dc35-7b95-4836-a5e9-7b7e75615d71 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:24:05.501530 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-2628dc35-7b95-4836-a5e9-7b7e75615d71 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.047201 Nov 22 12:24:05.502118 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 434/934] 10.222.0.66 () {60 vars in 1342 bytes} [Mon Nov 22 12:24:05 2021] GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:24:05.567209 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-7ebafe64-3d3e-4db6-89df-82e10769e7b9 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:24:05.567752 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-7ebafe64-3d3e-4db6-89df-82e10769e7b9 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: c9f6d441-246f-479e-8e88-ea701c0f87ff] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:24:05.575563 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-7ebafe64-3d3e-4db6-89df-82e10769e7b9 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:24:05.576014 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-7ebafe64-3d3e-4db6-89df-82e10769e7b9 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:24:05.576803 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-7ebafe64-3d3e-4db6-89df-82e10769e7b9 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:24:05.577233 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-7ebafe64-3d3e-4db6-89df-82e10769e7b9 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:24:05.603494 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-7ebafe64-3d3e-4db6-89df-82e10769e7b9 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: c9f6d441-246f-479e-8e88-ea701c0f87ff] Going to try to terminate instance {{(pid=116272) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 22 12:24:05.686741 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-7ebafe64-3d3e-4db6-89df-82e10769e7b9 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "DELETE /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff" status: 204 len: 0 microversion: 2.20 time: 0.125486 Nov 22 12:24:05.687383 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 501/935] 10.222.0.66 () {60 vars in 1279 bytes} [Mon Nov 22 12:24:05 2021] DELETE /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 22 12:24:05.696198 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-31c8638d-ddba-405d-aee9-0eed0febd50e tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:24:05.697038 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-31c8638d-ddba-405d-aee9-0eed0febd50e tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: c9f6d441-246f-479e-8e88-ea701c0f87ff] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:24:05.702961 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-31c8638d-ddba-405d-aee9-0eed0febd50e tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:24:05.703450 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-31c8638d-ddba-405d-aee9-0eed0febd50e tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:24:05.704216 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-31c8638d-ddba-405d-aee9-0eed0febd50e tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:24:05.704673 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-31c8638d-ddba-405d-aee9-0eed0febd50e tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:24:05.848110 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-31c8638d-ddba-405d-aee9-0eed0febd50e tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:24:05.856696 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-31c8638d-ddba-405d-aee9-0eed0febd50e tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:24:05.858168 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-31c8638d-ddba-405d-aee9-0eed0febd50e tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:24:05.859352 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-31c8638d-ddba-405d-aee9-0eed0febd50e tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff" status: 200 len: 1724 microversion: 2.20 time: 0.167063 Nov 22 12:24:05.859909 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 435/936] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Nov 22 12:24:05 2021] GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 12:24:06.880745 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-2164ad35-1a5e-447c-a3b9-fbabb38e51dd tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:24:06.881291 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-2164ad35-1a5e-447c-a3b9-fbabb38e51dd tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: c9f6d441-246f-479e-8e88-ea701c0f87ff] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:24:06.888111 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-2164ad35-1a5e-447c-a3b9-fbabb38e51dd tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:24:06.888553 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-2164ad35-1a5e-447c-a3b9-fbabb38e51dd tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:24:06.889341 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-2164ad35-1a5e-447c-a3b9-fbabb38e51dd tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:24:06.889767 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-2164ad35-1a5e-447c-a3b9-fbabb38e51dd tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:24:07.149314 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-2164ad35-1a5e-447c-a3b9-fbabb38e51dd tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:24:07.157941 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-2164ad35-1a5e-447c-a3b9-fbabb38e51dd tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:24:07.159469 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-2164ad35-1a5e-447c-a3b9-fbabb38e51dd tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:24:07.160619 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-2164ad35-1a5e-447c-a3b9-fbabb38e51dd tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff" status: 200 len: 1724 microversion: 2.20 time: 0.284131 Nov 22 12:24:07.161383 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 502/937] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Nov 22 12:24:06 2021] GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff => generated 1724 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 12:24:08.180383 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-90bd5e4d-8658-4024-832c-0d4f911fb004 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:24:08.180917 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-90bd5e4d-8658-4024-832c-0d4f911fb004 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: c9f6d441-246f-479e-8e88-ea701c0f87ff] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:24:08.187884 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-90bd5e4d-8658-4024-832c-0d4f911fb004 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:24:08.188335 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-90bd5e4d-8658-4024-832c-0d4f911fb004 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:24:08.189218 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-90bd5e4d-8658-4024-832c-0d4f911fb004 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:24:08.189854 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-90bd5e4d-8658-4024-832c-0d4f911fb004 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:24:08.347111 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-90bd5e4d-8658-4024-832c-0d4f911fb004 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:24:08.356722 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-90bd5e4d-8658-4024-832c-0d4f911fb004 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:24:08.358547 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-90bd5e4d-8658-4024-832c-0d4f911fb004 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:24:08.360013 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-90bd5e4d-8658-4024-832c-0d4f911fb004 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff" status: 200 len: 1656 microversion: 2.20 time: 0.183794 Nov 22 12:24:08.360959 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 436/938] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Nov 22 12:24:08 2021] GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff => generated 1656 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 12:24:08.419589 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [req-4c048eed-75b7-4162-816c-2691cc24e724 req-d1f69554-42fb-4b39-8104-7771b8c1875d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9f6d441-246f-479e-8e88-ea701c0f87ff", "name": "network-vif-deleted", "tag": "c3893e14-5c03-4b6a-b17d-c2dc56e8e688"}]} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:24:08.422270 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 12:24:08.422270 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: warnings.warn(msg) Nov 22 12:24:08.433552 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [req-4c048eed-75b7-4162-816c-2691cc24e724 req-d1f69554-42fb-4b39-8104-7771b8c1875d service nova] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:24:08.433925 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [req-4c048eed-75b7-4162-816c-2691cc24e724 req-d1f69554-42fb-4b39-8104-7771b8c1875d service nova] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:24:08.479427 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.compute.server_external_events [req-4c048eed-75b7-4162-816c-2691cc24e724 req-d1f69554-42fb-4b39-8104-7771b8c1875d service nova] Creating event network-vif-deleted:c3893e14-5c03-4b6a-b17d-c2dc56e8e688 for instance c9f6d441-246f-479e-8e88-ea701c0f87ff on hv-cinder-76845 Nov 22 12:24:08.494885 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [req-4c048eed-75b7-4162-816c-2691cc24e724 req-d1f69554-42fb-4b39-8104-7771b8c1875d service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075151 Nov 22 12:24:08.496548 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 503/939] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Nov 22 12:24:08 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 12:24:09.380091 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-5ec3b9e2-a5d2-414f-89d1-957c4d1eb69a tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:24:09.380932 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-5ec3b9e2-a5d2-414f-89d1-957c4d1eb69a tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: c9f6d441-246f-479e-8e88-ea701c0f87ff] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:24:09.388639 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-5ec3b9e2-a5d2-414f-89d1-957c4d1eb69a tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:24:09.389239 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-5ec3b9e2-a5d2-414f-89d1-957c4d1eb69a tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:24:09.390193 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-5ec3b9e2-a5d2-414f-89d1-957c4d1eb69a tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:24:09.390609 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-5ec3b9e2-a5d2-414f-89d1-957c4d1eb69a tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:24:09.405823 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.wsgi [None req-5ec3b9e2-a5d2-414f-89d1-957c4d1eb69a tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] HTTP exception thrown: Instance c9f6d441-246f-479e-8e88-ea701c0f87ff could not be found. Nov 22 12:24:09.406635 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-5ec3b9e2-a5d2-414f-89d1-957c4d1eb69a tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Returning 404 to user: Instance c9f6d441-246f-479e-8e88-ea701c0f87ff could not be found. {{(pid=116273) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 12:24:09.407480 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-5ec3b9e2-a5d2-414f-89d1-957c4d1eb69a tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff" status: 404 len: 111 microversion: 2.20 time: 0.031284 Nov 22 12:24:09.408469 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 437/940] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Nov 22 12:24:09 2021] GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 22 12:24:09.417247 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-d469231b-b44f-4908-ba1b-f37d2f668809 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Calling method '.version_select at 0x7fa1a324fd30>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:24:09.441822 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-d469231b-b44f-4908-ba1b-f37d2f668809 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-677996239" status: 204 len: 0 microversion: 2.20 time: 0.028894 Nov 22 12:24:09.442715 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 504/941] 10.222.0.66 () {60 vars in 1258 bytes} [Mon Nov 22 12:24:09 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-677996239 => generated 0 bytes in 30 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Nov 22 12:24:10.184790 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-4d386c3f-9ac6-489c-9463-4c49d097e5ae tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Action: 'create', calling method: .version_select at 0x7fa1a333b3a0>, body: {"keypair": {"name": "tempest-keypair-1813873829"}} {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:24:10.203735 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.quota [None req-4d386c3f-9ac6-489c-9463-4c49d097e5ae tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Getting quotas for project 086a36bf2fea4df7a4d72733b2f68dcd. Resources: {'key_pairs'} {{(pid=116273) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 22 12:24:10.209134 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.quota [None req-4d386c3f-9ac6-489c-9463-4c49d097e5ae tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Getting quotas for user 31f429dd496b45b9a9c2c13341cca92f and project 086a36bf2fea4df7a4d72733b2f68dcd. Resources: {'key_pairs'} {{(pid=116273) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 22 12:24:10.414532 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.quota [None req-4d386c3f-9ac6-489c-9463-4c49d097e5ae tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Getting quotas for project 086a36bf2fea4df7a4d72733b2f68dcd. Resources: {'key_pairs'} {{(pid=116273) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 22 12:24:10.418291 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.quota [None req-4d386c3f-9ac6-489c-9463-4c49d097e5ae tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Getting quotas for user 31f429dd496b45b9a9c2c13341cca92f and project 086a36bf2fea4df7a4d72733b2f68dcd. Resources: {'key_pairs'} {{(pid=116273) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 22 12:24:10.431642 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-4d386c3f-9ac6-489c-9463-4c49d097e5ae tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 201 len: 2320 microversion: 2.20 time: 0.254688 Nov 22 12:24:10.432269 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 438/942] 10.222.0.66 () {62 vars in 1198 bytes} [Mon Nov 22 12:24:10 2021] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 256 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Nov 22 12:24:11.782357 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-de11132e-3496-40f2-af39-037071b0a121 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-232991906", "imageRef": "31affc49-b6f0-44da-af65-4c65d72458b9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "47c7c2df-c485-45be-9ae4-891cba4c7953"}], "security_groups": [{"name": "tempest-securitygroup--908366312"}], "key_name": "tempest-keypair-1813873829", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:24:11.972686 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.network.neutron [None req-de11132e-3496-40f2-af39-037071b0a121 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] validate_networks() for [('47c7c2df-c485-45be-9ae4-891cba4c7953', None, None, None, None, None)] {{(pid=116272) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 22 12:24:12.512229 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.virt.hardware [None req-de11132e-3496-40f2-af39-037071b0a121 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Flavor limits 0:0:0 {{(pid=116272) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 22 12:24:12.512714 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.virt.hardware [None req-de11132e-3496-40f2-af39-037071b0a121 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Image limits 0:0:0 {{(pid=116272) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 22 12:24:12.513217 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.virt.hardware [None req-de11132e-3496-40f2-af39-037071b0a121 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Flavor pref 0:0:0 {{(pid=116272) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 22 12:24:12.513657 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.virt.hardware [None req-de11132e-3496-40f2-af39-037071b0a121 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Image pref 0:0:0 {{(pid=116272) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 22 12:24:12.514066 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.virt.hardware [None req-de11132e-3496-40f2-af39-037071b0a121 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116272) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 22 12:24:12.524035 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-de11132e-3496-40f2-af39-037071b0a121 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:24:12.524865 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-de11132e-3496-40f2-af39-037071b0a121 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:24:12.525821 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-de11132e-3496-40f2-af39-037071b0a121 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:24:12.526361 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-de11132e-3496-40f2-af39-037071b0a121 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:24:12.543137 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.quota [None req-de11132e-3496-40f2-af39-037071b0a121 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Getting quotas for project 086a36bf2fea4df7a4d72733b2f68dcd. Resources: {'ram', 'instances', 'cores'} {{(pid=116272) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 22 12:24:12.547194 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.quota [None req-de11132e-3496-40f2-af39-037071b0a121 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Getting quotas for user 31f429dd496b45b9a9c2c13341cca92f and project 086a36bf2fea4df7a4d72733b2f68dcd. Resources: {'ram', 'instances', 'cores'} {{(pid=116272) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 22 12:24:12.558470 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-de11132e-3496-40f2-af39-037071b0a121 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Going to run 1 instances... {{(pid=116272) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 22 12:24:12.560927 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-de11132e-3496-40f2-af39-037071b0a121 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: 496ce05f-ecc0-4dfd-b1d4-1c961f763af7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='31affc49-b6f0-44da-af65-4c65d72458b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116272) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 22 12:24:12.608203 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-de11132e-3496-40f2-af39-037071b0a121 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.830938 Nov 22 12:24:12.613954 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 505/943] 10.222.0.66 () {62 vars in 1187 bytes} [Mon Nov 22 12:24:11 2021] POST /compute/v2.1/servers => generated 401 bytes in 832 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 22 12:24:12.620291 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-21c53087-d9ad-420c-b431-1101bec5f48b tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:24:12.621155 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-21c53087-d9ad-420c-b431-1101bec5f48b tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: 496ce05f-ecc0-4dfd-b1d4-1c961f763af7] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:24:12.681683 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-21c53087-d9ad-420c-b431-1101bec5f48b tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:24:12.690067 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-21c53087-d9ad-420c-b431-1101bec5f48b tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:24:12.691766 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-21c53087-d9ad-420c-b431-1101bec5f48b tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:24:12.693235 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-21c53087-d9ad-420c-b431-1101bec5f48b tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "GET /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7" status: 200 len: 1281 microversion: 2.20 time: 0.077725 Nov 22 12:24:12.693814 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 439/944] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Nov 22 12:24:12 2021] GET /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7 => generated 1281 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 12:24:13.713283 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-c2048e01-3abe-47cd-ae12-780e89a53442 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:24:13.714637 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-c2048e01-3abe-47cd-ae12-780e89a53442 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: 496ce05f-ecc0-4dfd-b1d4-1c961f763af7] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:24:13.733655 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-c2048e01-3abe-47cd-ae12-780e89a53442 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:24:13.734669 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-c2048e01-3abe-47cd-ae12-780e89a53442 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:24:13.737001 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-c2048e01-3abe-47cd-ae12-780e89a53442 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:24:13.737942 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-c2048e01-3abe-47cd-ae12-780e89a53442 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:24:13.834959 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-c2048e01-3abe-47cd-ae12-780e89a53442 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:24:13.850110 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-c2048e01-3abe-47cd-ae12-780e89a53442 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:24:13.852805 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-c2048e01-3abe-47cd-ae12-780e89a53442 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:24:13.854262 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-c2048e01-3abe-47cd-ae12-780e89a53442 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "GET /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7" status: 200 len: 1351 microversion: 2.20 time: 0.145795 Nov 22 12:24:13.855018 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 506/945] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Nov 22 12:24:13 2021] GET /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7 => generated 1351 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 22 12:24:14.873521 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-97014d47-16a3-4f4f-b622-ab09b532a400 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:24:14.874323 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-97014d47-16a3-4f4f-b622-ab09b532a400 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: 496ce05f-ecc0-4dfd-b1d4-1c961f763af7] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:24:14.880880 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-97014d47-16a3-4f4f-b622-ab09b532a400 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:24:14.881323 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-97014d47-16a3-4f4f-b622-ab09b532a400 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:24:14.882964 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-97014d47-16a3-4f4f-b622-ab09b532a400 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:24:14.883450 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-97014d47-16a3-4f4f-b622-ab09b532a400 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:24:15.230267 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-97014d47-16a3-4f4f-b622-ab09b532a400 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:24:15.248219 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-97014d47-16a3-4f4f-b622-ab09b532a400 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:24:15.251804 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-97014d47-16a3-4f4f-b622-ab09b532a400 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:24:15.253926 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-97014d47-16a3-4f4f-b622-ab09b532a400 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "GET /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7" status: 200 len: 1406 microversion: 2.20 time: 0.384146 Nov 22 12:24:15.254744 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 440/946] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Nov 22 12:24:14 2021] GET /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7 => generated 1406 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 22 12:24:15.486653 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [req-e3cb85f1-c99c-42a2-ad32-aa48b9669c5b req-4d26f9ed-3e5c-4b03-9335-3667d2096d04 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "496ce05f-ecc0-4dfd-b1d4-1c961f763af7", "tag": "94a1cac1-1361-4086-b60b-55660b9c75fc"}]} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:24:15.491182 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 12:24:15.491182 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: warnings.warn(msg) Nov 22 12:24:15.504240 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [req-e3cb85f1-c99c-42a2-ad32-aa48b9669c5b req-4d26f9ed-3e5c-4b03-9335-3667d2096d04 service nova] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:24:15.505133 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [req-e3cb85f1-c99c-42a2-ad32-aa48b9669c5b req-4d26f9ed-3e5c-4b03-9335-3667d2096d04 service nova] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:24:15.523143 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.compute.server_external_events [req-e3cb85f1-c99c-42a2-ad32-aa48b9669c5b req-4d26f9ed-3e5c-4b03-9335-3667d2096d04 service nova] Creating event network-changed:94a1cac1-1361-4086-b60b-55660b9c75fc for instance 496ce05f-ecc0-4dfd-b1d4-1c961f763af7 on hv-cinder-76845 Nov 22 12:24:15.530760 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [req-e3cb85f1-c99c-42a2-ad32-aa48b9669c5b req-4d26f9ed-3e5c-4b03-9335-3667d2096d04 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051135 Nov 22 12:24:15.532122 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 507/947] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Nov 22 12:24:15 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 12:24:16.282879 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-0f07fef9-4975-4058-b98b-cf620d049e88 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:24:16.283741 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-0f07fef9-4975-4058-b98b-cf620d049e88 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: 496ce05f-ecc0-4dfd-b1d4-1c961f763af7] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:24:16.290793 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-0f07fef9-4975-4058-b98b-cf620d049e88 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:24:16.291519 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-0f07fef9-4975-4058-b98b-cf620d049e88 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:24:16.292260 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-0f07fef9-4975-4058-b98b-cf620d049e88 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:24:16.292767 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-0f07fef9-4975-4058-b98b-cf620d049e88 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:24:16.437430 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-0f07fef9-4975-4058-b98b-cf620d049e88 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:24:16.445613 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-0f07fef9-4975-4058-b98b-cf620d049e88 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:24:16.447081 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-0f07fef9-4975-4058-b98b-cf620d049e88 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:24:16.448241 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-0f07fef9-4975-4058-b98b-cf620d049e88 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "GET /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7" status: 200 len: 1406 microversion: 2.20 time: 0.169494 Nov 22 12:24:16.449108 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 441/948] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Nov 22 12:24:16 2021] GET /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7 => generated 1406 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 12:24:17.467198 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-077ec103-036f-4977-a2d9-3a752d01fe41 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:24:17.467805 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-077ec103-036f-4977-a2d9-3a752d01fe41 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: 496ce05f-ecc0-4dfd-b1d4-1c961f763af7] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:24:17.474756 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-077ec103-036f-4977-a2d9-3a752d01fe41 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:24:17.475213 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-077ec103-036f-4977-a2d9-3a752d01fe41 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:24:17.476075 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-077ec103-036f-4977-a2d9-3a752d01fe41 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:24:17.477059 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-077ec103-036f-4977-a2d9-3a752d01fe41 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:24:17.614581 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-077ec103-036f-4977-a2d9-3a752d01fe41 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:24:17.622629 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-077ec103-036f-4977-a2d9-3a752d01fe41 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:24:17.624147 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-077ec103-036f-4977-a2d9-3a752d01fe41 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:24:17.625253 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-077ec103-036f-4977-a2d9-3a752d01fe41 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "GET /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7" status: 200 len: 1406 microversion: 2.20 time: 0.162352 Nov 22 12:24:17.625841 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 508/949] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Nov 22 12:24:17 2021] GET /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7 => generated 1406 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 12:24:18.645952 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-0641002f-5ea3-4c70-8b37-7590bdb2e148 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:24:18.646574 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-0641002f-5ea3-4c70-8b37-7590bdb2e148 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: 496ce05f-ecc0-4dfd-b1d4-1c961f763af7] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:24:18.654720 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-0641002f-5ea3-4c70-8b37-7590bdb2e148 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:24:18.655175 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-0641002f-5ea3-4c70-8b37-7590bdb2e148 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:24:18.656034 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-0641002f-5ea3-4c70-8b37-7590bdb2e148 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:24:18.656461 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-0641002f-5ea3-4c70-8b37-7590bdb2e148 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:24:18.800397 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-0641002f-5ea3-4c70-8b37-7590bdb2e148 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:24:18.809602 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-0641002f-5ea3-4c70-8b37-7590bdb2e148 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:24:18.811071 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-0641002f-5ea3-4c70-8b37-7590bdb2e148 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:24:18.812196 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-0641002f-5ea3-4c70-8b37-7590bdb2e148 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "GET /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7" status: 200 len: 1406 microversion: 2.20 time: 0.170074 Nov 22 12:24:18.812735 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 442/950] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Nov 22 12:24:18 2021] GET /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7 => generated 1406 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 12:24:19.830255 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-233ae22a-d1ef-4e67-ab09-9be643303e16 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:24:19.830809 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-233ae22a-d1ef-4e67-ab09-9be643303e16 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: 496ce05f-ecc0-4dfd-b1d4-1c961f763af7] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:24:19.837993 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-233ae22a-d1ef-4e67-ab09-9be643303e16 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:24:19.838449 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-233ae22a-d1ef-4e67-ab09-9be643303e16 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:24:19.839300 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-233ae22a-d1ef-4e67-ab09-9be643303e16 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:24:19.839757 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-233ae22a-d1ef-4e67-ab09-9be643303e16 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:24:19.981649 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-233ae22a-d1ef-4e67-ab09-9be643303e16 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:24:19.990431 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-233ae22a-d1ef-4e67-ab09-9be643303e16 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:24:19.992361 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-233ae22a-d1ef-4e67-ab09-9be643303e16 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:24:19.993938 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-233ae22a-d1ef-4e67-ab09-9be643303e16 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "GET /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7" status: 200 len: 1406 microversion: 2.20 time: 0.167399 Nov 22 12:24:19.994485 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 509/951] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Nov 22 12:24:19 2021] GET /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7 => generated 1406 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 12:24:21.014532 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-4e22bb83-c7a2-4e42-a6ab-db2e284a8a33 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:24:21.015171 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-4e22bb83-c7a2-4e42-a6ab-db2e284a8a33 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: 496ce05f-ecc0-4dfd-b1d4-1c961f763af7] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:24:21.025860 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-4e22bb83-c7a2-4e42-a6ab-db2e284a8a33 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:24:21.026310 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-4e22bb83-c7a2-4e42-a6ab-db2e284a8a33 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:24:21.027102 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-4e22bb83-c7a2-4e42-a6ab-db2e284a8a33 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:24:21.028081 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-4e22bb83-c7a2-4e42-a6ab-db2e284a8a33 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:24:21.177173 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-4e22bb83-c7a2-4e42-a6ab-db2e284a8a33 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:24:21.185676 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-4e22bb83-c7a2-4e42-a6ab-db2e284a8a33 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:24:21.187251 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-4e22bb83-c7a2-4e42-a6ab-db2e284a8a33 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:24:21.188415 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-4e22bb83-c7a2-4e42-a6ab-db2e284a8a33 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "GET /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7" status: 200 len: 1406 microversion: 2.20 time: 0.178747 Nov 22 12:24:21.189058 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 443/952] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Nov 22 12:24:21 2021] GET /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7 => generated 1406 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 12:24:22.209833 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-9b6ef9b9-dc2e-4d98-be50-343652b8e7b5 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:24:22.210615 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-9b6ef9b9-dc2e-4d98-be50-343652b8e7b5 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: 496ce05f-ecc0-4dfd-b1d4-1c961f763af7] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:24:22.222210 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-9b6ef9b9-dc2e-4d98-be50-343652b8e7b5 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:24:22.222660 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-9b6ef9b9-dc2e-4d98-be50-343652b8e7b5 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:24:22.223487 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-9b6ef9b9-dc2e-4d98-be50-343652b8e7b5 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:24:22.223919 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-9b6ef9b9-dc2e-4d98-be50-343652b8e7b5 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:24:22.367766 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-9b6ef9b9-dc2e-4d98-be50-343652b8e7b5 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:24:22.378869 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-9b6ef9b9-dc2e-4d98-be50-343652b8e7b5 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:24:22.380441 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-9b6ef9b9-dc2e-4d98-be50-343652b8e7b5 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:24:22.381604 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-9b6ef9b9-dc2e-4d98-be50-343652b8e7b5 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "GET /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7" status: 200 len: 1406 microversion: 2.20 time: 0.177572 Nov 22 12:24:22.382234 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 510/953] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Nov 22 12:24:22 2021] GET /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7 => generated 1406 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 12:24:23.401316 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-85f030b0-ad35-417e-a961-3dc5bdcab80a tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:24:23.401916 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-85f030b0-ad35-417e-a961-3dc5bdcab80a tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: 496ce05f-ecc0-4dfd-b1d4-1c961f763af7] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:24:23.409120 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-85f030b0-ad35-417e-a961-3dc5bdcab80a tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:24:23.409567 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-85f030b0-ad35-417e-a961-3dc5bdcab80a tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:24:23.410411 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-85f030b0-ad35-417e-a961-3dc5bdcab80a tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:24:23.410839 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-85f030b0-ad35-417e-a961-3dc5bdcab80a tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:24:23.552011 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-85f030b0-ad35-417e-a961-3dc5bdcab80a tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:24:23.563764 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-85f030b0-ad35-417e-a961-3dc5bdcab80a tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:24:23.566172 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-85f030b0-ad35-417e-a961-3dc5bdcab80a tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:24:23.567787 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-85f030b0-ad35-417e-a961-3dc5bdcab80a tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "GET /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7" status: 200 len: 1406 microversion: 2.20 time: 0.171580 Nov 22 12:24:23.568573 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 444/954] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Nov 22 12:24:23 2021] GET /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7 => generated 1406 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 12:24:24.586812 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-abf353ea-c59a-4802-bdf5-757b874099f7 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:24:24.587453 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-abf353ea-c59a-4802-bdf5-757b874099f7 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: 496ce05f-ecc0-4dfd-b1d4-1c961f763af7] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:24:24.593878 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-abf353ea-c59a-4802-bdf5-757b874099f7 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:24:24.594321 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-abf353ea-c59a-4802-bdf5-757b874099f7 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:24:24.595101 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-abf353ea-c59a-4802-bdf5-757b874099f7 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:24:24.595597 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-abf353ea-c59a-4802-bdf5-757b874099f7 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:24:24.736741 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-abf353ea-c59a-4802-bdf5-757b874099f7 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:24:24.745962 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-abf353ea-c59a-4802-bdf5-757b874099f7 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:24:24.747371 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-abf353ea-c59a-4802-bdf5-757b874099f7 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:24:24.748494 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-abf353ea-c59a-4802-bdf5-757b874099f7 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "GET /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7" status: 200 len: 1406 microversion: 2.20 time: 0.166036 Nov 22 12:24:24.749057 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 511/955] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Nov 22 12:24:24 2021] GET /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7 => generated 1406 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 12:24:25.767343 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-143dbed1-4612-4763-a4bb-2dfe81084739 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:24:25.767902 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-143dbed1-4612-4763-a4bb-2dfe81084739 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: 496ce05f-ecc0-4dfd-b1d4-1c961f763af7] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:24:25.776035 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-143dbed1-4612-4763-a4bb-2dfe81084739 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:24:25.776500 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-143dbed1-4612-4763-a4bb-2dfe81084739 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:24:25.777274 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-143dbed1-4612-4763-a4bb-2dfe81084739 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:24:25.778047 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-143dbed1-4612-4763-a4bb-2dfe81084739 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:24:25.922400 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-143dbed1-4612-4763-a4bb-2dfe81084739 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:24:25.931034 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-143dbed1-4612-4763-a4bb-2dfe81084739 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:24:25.932599 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-143dbed1-4612-4763-a4bb-2dfe81084739 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:24:25.933716 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-143dbed1-4612-4763-a4bb-2dfe81084739 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "GET /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7" status: 200 len: 1406 microversion: 2.20 time: 0.170298 Nov 22 12:24:25.934281 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 445/956] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Nov 22 12:24:25 2021] GET /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7 => generated 1406 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 12:24:26.952952 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-e22a426b-4fe5-47ca-bf6b-da3c2c8d8d12 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:24:26.953775 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-e22a426b-4fe5-47ca-bf6b-da3c2c8d8d12 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: 496ce05f-ecc0-4dfd-b1d4-1c961f763af7] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:24:26.960742 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-e22a426b-4fe5-47ca-bf6b-da3c2c8d8d12 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:24:26.961253 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-e22a426b-4fe5-47ca-bf6b-da3c2c8d8d12 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:24:26.962053 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-e22a426b-4fe5-47ca-bf6b-da3c2c8d8d12 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:24:26.962471 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-e22a426b-4fe5-47ca-bf6b-da3c2c8d8d12 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:24:27.032115 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [req-4bc4ba49-59da-450c-adba-a58dcafebf60 req-19593b5d-a29f-4fb7-898a-d9d5ac6c5cc3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "496ce05f-ecc0-4dfd-b1d4-1c961f763af7", "name": "network-vif-plugged", "status": "completed", "tag": "94a1cac1-1361-4086-b60b-55660b9c75fc"}]} {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:24:27.033891 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 12:24:27.033891 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: warnings.warn(msg) Nov 22 12:24:27.042678 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [req-4bc4ba49-59da-450c-adba-a58dcafebf60 req-19593b5d-a29f-4fb7-898a-d9d5ac6c5cc3 service nova] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:24:27.043479 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [req-4bc4ba49-59da-450c-adba-a58dcafebf60 req-19593b5d-a29f-4fb7-898a-d9d5ac6c5cc3 service nova] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:24:27.067360 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.compute.server_external_events [req-4bc4ba49-59da-450c-adba-a58dcafebf60 req-19593b5d-a29f-4fb7-898a-d9d5ac6c5cc3 service nova] Creating event network-vif-plugged:94a1cac1-1361-4086-b60b-55660b9c75fc for instance 496ce05f-ecc0-4dfd-b1d4-1c961f763af7 on hv-cinder-76845 Nov 22 12:24:27.073314 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [req-4bc4ba49-59da-450c-adba-a58dcafebf60 req-19593b5d-a29f-4fb7-898a-d9d5ac6c5cc3 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045270 Nov 22 12:24:27.074340 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 446/957] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Nov 22 12:24:27 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 12:24:27.339886 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-e22a426b-4fe5-47ca-bf6b-da3c2c8d8d12 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:24:27.354888 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-e22a426b-4fe5-47ca-bf6b-da3c2c8d8d12 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:24:27.356473 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-e22a426b-4fe5-47ca-bf6b-da3c2c8d8d12 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:24:27.357630 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-e22a426b-4fe5-47ca-bf6b-da3c2c8d8d12 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "GET /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7" status: 200 len: 1406 microversion: 2.20 time: 0.408657 Nov 22 12:24:27.358199 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 512/958] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Nov 22 12:24:26 2021] GET /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7 => generated 1406 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 12:24:28.388196 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-2872751b-67f7-4dc3-98fc-b520e8fca20d tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:24:28.388910 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-2872751b-67f7-4dc3-98fc-b520e8fca20d tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: 496ce05f-ecc0-4dfd-b1d4-1c961f763af7] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:24:28.395692 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-2872751b-67f7-4dc3-98fc-b520e8fca20d tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:24:28.396148 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-2872751b-67f7-4dc3-98fc-b520e8fca20d tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:24:28.396966 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-2872751b-67f7-4dc3-98fc-b520e8fca20d tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:24:28.397414 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-2872751b-67f7-4dc3-98fc-b520e8fca20d tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:24:28.545921 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-2872751b-67f7-4dc3-98fc-b520e8fca20d tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:24:28.555349 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-2872751b-67f7-4dc3-98fc-b520e8fca20d tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:24:28.556873 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-2872751b-67f7-4dc3-98fc-b520e8fca20d tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:24:28.558008 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-2872751b-67f7-4dc3-98fc-b520e8fca20d tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "GET /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7" status: 200 len: 1406 microversion: 2.20 time: 0.175075 Nov 22 12:24:28.558553 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 447/959] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Nov 22 12:24:28 2021] GET /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7 => generated 1406 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 12:24:29.577152 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-d89999be-c0ab-46f2-a147-b1cfc4b35958 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:24:29.577746 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-d89999be-c0ab-46f2-a147-b1cfc4b35958 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: 496ce05f-ecc0-4dfd-b1d4-1c961f763af7] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:24:29.584793 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-d89999be-c0ab-46f2-a147-b1cfc4b35958 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:24:29.585297 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-d89999be-c0ab-46f2-a147-b1cfc4b35958 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:24:29.586125 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-d89999be-c0ab-46f2-a147-b1cfc4b35958 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:24:29.586562 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-d89999be-c0ab-46f2-a147-b1cfc4b35958 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:24:29.747922 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-d89999be-c0ab-46f2-a147-b1cfc4b35958 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:24:29.756330 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-d89999be-c0ab-46f2-a147-b1cfc4b35958 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:24:29.758157 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-d89999be-c0ab-46f2-a147-b1cfc4b35958 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:24:29.759382 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-d89999be-c0ab-46f2-a147-b1cfc4b35958 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "GET /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7" status: 200 len: 1406 microversion: 2.20 time: 0.186049 Nov 22 12:24:29.759950 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 513/960] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Nov 22 12:24:29 2021] GET /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7 => generated 1406 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 12:24:30.785077 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-c700289a-cf05-4f72-bb80-334e4229c91a tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:24:30.785692 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-c700289a-cf05-4f72-bb80-334e4229c91a tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: 496ce05f-ecc0-4dfd-b1d4-1c961f763af7] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:24:30.793419 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-c700289a-cf05-4f72-bb80-334e4229c91a tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:24:30.793879 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-c700289a-cf05-4f72-bb80-334e4229c91a tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:24:30.794689 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-c700289a-cf05-4f72-bb80-334e4229c91a tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:24:30.795116 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-c700289a-cf05-4f72-bb80-334e4229c91a tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:24:30.943975 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-c700289a-cf05-4f72-bb80-334e4229c91a tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:24:30.958442 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-c700289a-cf05-4f72-bb80-334e4229c91a tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:24:30.961762 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-c700289a-cf05-4f72-bb80-334e4229c91a tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:24:30.964158 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-c700289a-cf05-4f72-bb80-334e4229c91a tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "GET /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7" status: 200 len: 1406 microversion: 2.20 time: 0.182469 Nov 22 12:24:30.965717 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 448/961] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Nov 22 12:24:30 2021] GET /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7 => generated 1406 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 12:24:31.986588 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-6e09203a-d0f5-4c12-9f7f-2111c4996536 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:24:31.987498 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-6e09203a-d0f5-4c12-9f7f-2111c4996536 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: 496ce05f-ecc0-4dfd-b1d4-1c961f763af7] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:24:31.994522 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-6e09203a-d0f5-4c12-9f7f-2111c4996536 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:24:31.994969 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-6e09203a-d0f5-4c12-9f7f-2111c4996536 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:24:31.996732 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-6e09203a-d0f5-4c12-9f7f-2111c4996536 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:24:31.997192 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-6e09203a-d0f5-4c12-9f7f-2111c4996536 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:24:32.150321 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-6e09203a-d0f5-4c12-9f7f-2111c4996536 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:24:32.159106 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-6e09203a-d0f5-4c12-9f7f-2111c4996536 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:24:32.160644 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-6e09203a-d0f5-4c12-9f7f-2111c4996536 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:24:32.161823 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-6e09203a-d0f5-4c12-9f7f-2111c4996536 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "GET /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7" status: 200 len: 1597 microversion: 2.20 time: 0.180960 Nov 22 12:24:32.162390 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 514/962] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Nov 22 12:24:31 2021] GET /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7 => generated 1597 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 12:24:32.180049 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-9f6c87e2-34df-4561-b43c-eecf11933563 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:24:32.180930 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-9f6c87e2-34df-4561-b43c-eecf11933563 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: 496ce05f-ecc0-4dfd-b1d4-1c961f763af7] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:24:32.191148 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-9f6c87e2-34df-4561-b43c-eecf11933563 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:24:32.191990 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-9f6c87e2-34df-4561-b43c-eecf11933563 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:24:32.193088 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-9f6c87e2-34df-4561-b43c-eecf11933563 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:24:32.193635 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-9f6c87e2-34df-4561-b43c-eecf11933563 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:24:32.320873 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-9f6c87e2-34df-4561-b43c-eecf11933563 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "GET /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.145201 Nov 22 12:24:32.321702 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 449/963] 10.222.0.66 () {60 vars in 1315 bytes} [Mon Nov 22 12:24:32 2021] GET /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7/os-interface => generated 284 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 22 12:24:33.129646 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-674fdf2a-9d7f-4da6-a75e-fe001297d69e tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:24:33.130597 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-674fdf2a-9d7f-4da6-a75e-fe001297d69e tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] [instance: 131dcb5b-f62d-42ec-b0d0-588a120aa1d3] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:24:33.139806 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-674fdf2a-9d7f-4da6-a75e-fe001297d69e tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:24:33.141003 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-674fdf2a-9d7f-4da6-a75e-fe001297d69e tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:24:33.141288 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-674fdf2a-9d7f-4da6-a75e-fe001297d69e tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:24:33.141763 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-674fdf2a-9d7f-4da6-a75e-fe001297d69e tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:24:33.220912 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-674fdf2a-9d7f-4da6-a75e-fe001297d69e tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] 10.222.0.66 "POST /compute/v2.1/servers/131dcb5b-f62d-42ec-b0d0-588a120aa1d3/action" status: 202 len: 0 microversion: 2.1 time: 0.094983 Nov 22 12:24:33.222647 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 515/964] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Nov 22 12:24:33 2021] POST /compute/v2.1/servers/131dcb5b-f62d-42ec-b0d0-588a120aa1d3/action => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 22 12:24:33.231916 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-0a3cda03-0448-4c69-a5f1-beef1888b113 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:24:33.232542 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-0a3cda03-0448-4c69-a5f1-beef1888b113 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] [instance: 131dcb5b-f62d-42ec-b0d0-588a120aa1d3] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:24:33.243339 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-0a3cda03-0448-4c69-a5f1-beef1888b113 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:24:33.244293 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-0a3cda03-0448-4c69-a5f1-beef1888b113 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:24:33.245883 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-0a3cda03-0448-4c69-a5f1-beef1888b113 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:24:33.246653 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-0a3cda03-0448-4c69-a5f1-beef1888b113 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:24:33.401231 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-3ff5e26d-4ede-4b89-8aa9-c7d9b1397392 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:24:33.403086 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-3ff5e26d-4ede-4b89-8aa9-c7d9b1397392 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: 496ce05f-ecc0-4dfd-b1d4-1c961f763af7] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:24:33.411268 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-0a3cda03-0448-4c69-a5f1-beef1888b113 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc2a99b8e8f244aab8bd6545355ee044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b282b4e5e2147a692e990f45ce44b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:24:33.417371 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-3ff5e26d-4ede-4b89-8aa9-c7d9b1397392 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:24:33.419306 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-3ff5e26d-4ede-4b89-8aa9-c7d9b1397392 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:24:33.420301 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-3ff5e26d-4ede-4b89-8aa9-c7d9b1397392 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:24:33.421926 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-3ff5e26d-4ede-4b89-8aa9-c7d9b1397392 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:24:33.431275 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-0a3cda03-0448-4c69-a5f1-beef1888b113 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] 10.222.0.66 "GET /compute/v2.1/servers/131dcb5b-f62d-42ec-b0d0-588a120aa1d3" status: 200 len: 1750 microversion: 2.1 time: 0.204737 Nov 22 12:24:33.433095 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 450/965] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:24:33 2021] GET /compute/v2.1/servers/131dcb5b-f62d-42ec-b0d0-588a120aa1d3 => generated 1750 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 12:24:33.507835 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-3ff5e26d-4ede-4b89-8aa9-c7d9b1397392 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "POST /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7/action" status: 200 len: 14 microversion: 2.20 time: 0.112899 Nov 22 12:24:33.512520 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 516/966] 10.222.0.66 () {62 vars in 1318 bytes} [Mon Nov 22 12:24:33 2021] POST /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7/action => generated 14 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:24:33.629565 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [req-248172c4-52a8-4846-b486-9bdf37f45c85 req-734b7b30-d81d-4d75-b3d0-5023c29e3023 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "496ce05f-ecc0-4dfd-b1d4-1c961f763af7", "tag": "94a1cac1-1361-4086-b60b-55660b9c75fc"}]} {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:24:33.631164 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 12:24:33.631164 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: warnings.warn(msg) Nov 22 12:24:33.644133 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [req-248172c4-52a8-4846-b486-9bdf37f45c85 req-734b7b30-d81d-4d75-b3d0-5023c29e3023 service nova] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:24:33.645097 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [req-248172c4-52a8-4846-b486-9bdf37f45c85 req-734b7b30-d81d-4d75-b3d0-5023c29e3023 service nova] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:24:33.657409 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.compute.server_external_events [req-248172c4-52a8-4846-b486-9bdf37f45c85 req-734b7b30-d81d-4d75-b3d0-5023c29e3023 service nova] Creating event network-changed:94a1cac1-1361-4086-b60b-55660b9c75fc for instance 496ce05f-ecc0-4dfd-b1d4-1c961f763af7 on hv-cinder-76845 Nov 22 12:24:33.663176 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [req-248172c4-52a8-4846-b486-9bdf37f45c85 req-734b7b30-d81d-4d75-b3d0-5023c29e3023 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.228772 Nov 22 12:24:33.663817 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 451/967] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Nov 22 12:24:33 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 12:24:34.459457 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-a6cdde0d-e05a-42ca-8c15-b669854b1b8a tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:24:34.460947 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-a6cdde0d-e05a-42ca-8c15-b669854b1b8a tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] [instance: 131dcb5b-f62d-42ec-b0d0-588a120aa1d3] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:24:34.468919 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-a6cdde0d-e05a-42ca-8c15-b669854b1b8a tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:24:34.469413 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-a6cdde0d-e05a-42ca-8c15-b669854b1b8a tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:24:34.470224 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-a6cdde0d-e05a-42ca-8c15-b669854b1b8a tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:24:34.470660 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-a6cdde0d-e05a-42ca-8c15-b669854b1b8a tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:24:34.526107 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-cf484e83-c069-4e73-972e-462ea5e3fefe tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:24:34.528330 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-cf484e83-c069-4e73-972e-462ea5e3fefe tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: 496ce05f-ecc0-4dfd-b1d4-1c961f763af7] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:24:34.543172 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-cf484e83-c069-4e73-972e-462ea5e3fefe tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:24:34.544011 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-cf484e83-c069-4e73-972e-462ea5e3fefe tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:24:34.545201 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-cf484e83-c069-4e73-972e-462ea5e3fefe tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:24:34.546316 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-cf484e83-c069-4e73-972e-462ea5e3fefe tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:24:34.623560 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-cf484e83-c069-4e73-972e-462ea5e3fefe tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "POST /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7/action" status: 200 len: 14 microversion: 2.20 time: 0.106011 Nov 22 12:24:34.625109 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 452/968] 10.222.0.66 () {62 vars in 1318 bytes} [Mon Nov 22 12:24:34 2021] POST /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7/action => generated 14 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:24:34.633949 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-a6cdde0d-e05a-42ca-8c15-b669854b1b8a tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc2a99b8e8f244aab8bd6545355ee044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b282b4e5e2147a692e990f45ce44b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:24:34.642491 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-a6cdde0d-e05a-42ca-8c15-b669854b1b8a tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] 10.222.0.66 "GET /compute/v2.1/servers/131dcb5b-f62d-42ec-b0d0-588a120aa1d3" status: 200 len: 1755 microversion: 2.1 time: 0.188167 Nov 22 12:24:34.643074 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 517/969] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:24:34 2021] GET /compute/v2.1/servers/131dcb5b-f62d-42ec-b0d0-588a120aa1d3 => generated 1755 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:24:35.636504 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-c362adcc-2d2b-42f3-b3fb-f64a7a503802 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:24:35.637553 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-c362adcc-2d2b-42f3-b3fb-f64a7a503802 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: 496ce05f-ecc0-4dfd-b1d4-1c961f763af7] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:24:35.644680 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-c362adcc-2d2b-42f3-b3fb-f64a7a503802 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:24:35.645131 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-c362adcc-2d2b-42f3-b3fb-f64a7a503802 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:24:35.645920 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-c362adcc-2d2b-42f3-b3fb-f64a7a503802 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:24:35.646322 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-c362adcc-2d2b-42f3-b3fb-f64a7a503802 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:24:35.661713 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-efadd3f6-29c0-4c9d-a113-c6034c24cc4a tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:24:35.662767 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-efadd3f6-29c0-4c9d-a113-c6034c24cc4a tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] [instance: 131dcb5b-f62d-42ec-b0d0-588a120aa1d3] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:24:35.670003 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-efadd3f6-29c0-4c9d-a113-c6034c24cc4a tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:24:35.670453 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-efadd3f6-29c0-4c9d-a113-c6034c24cc4a tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:24:35.671239 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-efadd3f6-29c0-4c9d-a113-c6034c24cc4a tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:24:35.671699 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-efadd3f6-29c0-4c9d-a113-c6034c24cc4a tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:24:35.706919 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-c362adcc-2d2b-42f3-b3fb-f64a7a503802 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "POST /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7/action" status: 200 len: 14 microversion: 2.20 time: 0.074834 Nov 22 12:24:35.707587 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 453/970] 10.222.0.66 () {62 vars in 1318 bytes} [Mon Nov 22 12:24:35 2021] POST /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7/action => generated 14 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:24:35.847457 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-efadd3f6-29c0-4c9d-a113-c6034c24cc4a tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc2a99b8e8f244aab8bd6545355ee044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b282b4e5e2147a692e990f45ce44b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:24:35.856292 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-efadd3f6-29c0-4c9d-a113-c6034c24cc4a tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] 10.222.0.66 "GET /compute/v2.1/servers/131dcb5b-f62d-42ec-b0d0-588a120aa1d3" status: 200 len: 1755 microversion: 2.1 time: 0.199086 Nov 22 12:24:35.856873 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 518/971] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:24:35 2021] GET /compute/v2.1/servers/131dcb5b-f62d-42ec-b0d0-588a120aa1d3 => generated 1755 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:24:36.718616 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-5bc104f4-5be7-4532-bc9c-f8467906b250 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:24:36.719910 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-5bc104f4-5be7-4532-bc9c-f8467906b250 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: 496ce05f-ecc0-4dfd-b1d4-1c961f763af7] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:24:36.727567 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-5bc104f4-5be7-4532-bc9c-f8467906b250 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:24:36.728177 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-5bc104f4-5be7-4532-bc9c-f8467906b250 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:24:36.729059 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-5bc104f4-5be7-4532-bc9c-f8467906b250 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:24:36.729498 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-5bc104f4-5be7-4532-bc9c-f8467906b250 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:24:36.803255 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-5bc104f4-5be7-4532-bc9c-f8467906b250 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "POST /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7/action" status: 200 len: 14 microversion: 2.20 time: 0.088761 Nov 22 12:24:36.804082 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 454/972] 10.222.0.66 () {62 vars in 1318 bytes} [Mon Nov 22 12:24:36 2021] POST /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7/action => generated 14 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:24:36.873263 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-bc5eac50-3bad-45b0-afbb-8f43d6322f06 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:24:36.873871 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-bc5eac50-3bad-45b0-afbb-8f43d6322f06 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] [instance: 131dcb5b-f62d-42ec-b0d0-588a120aa1d3] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:24:36.880549 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-bc5eac50-3bad-45b0-afbb-8f43d6322f06 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:24:36.880997 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-bc5eac50-3bad-45b0-afbb-8f43d6322f06 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:24:36.881774 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-bc5eac50-3bad-45b0-afbb-8f43d6322f06 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:24:36.882217 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-bc5eac50-3bad-45b0-afbb-8f43d6322f06 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:24:37.030912 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-bc5eac50-3bad-45b0-afbb-8f43d6322f06 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc2a99b8e8f244aab8bd6545355ee044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b282b4e5e2147a692e990f45ce44b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:24:37.038824 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-bc5eac50-3bad-45b0-afbb-8f43d6322f06 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] 10.222.0.66 "GET /compute/v2.1/servers/131dcb5b-f62d-42ec-b0d0-588a120aa1d3" status: 200 len: 1755 microversion: 2.1 time: 0.169252 Nov 22 12:24:37.039643 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 519/973] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:24:36 2021] GET /compute/v2.1/servers/131dcb5b-f62d-42ec-b0d0-588a120aa1d3 => generated 1755 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:24:37.279585 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-4485f110-457a-4828-a3ce-cd1c9212413e tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:24:37.280171 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-4485f110-457a-4828-a3ce-cd1c9212413e tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: 2306113c-8f98-42fd-8c0c-3dfac98fff21] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:24:37.287432 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-4485f110-457a-4828-a3ce-cd1c9212413e tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:24:37.287877 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-4485f110-457a-4828-a3ce-cd1c9212413e tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:24:37.288661 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-4485f110-457a-4828-a3ce-cd1c9212413e tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:24:37.289224 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-4485f110-457a-4828-a3ce-cd1c9212413e tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:24:37.385515 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.objects.instance [None req-4485f110-457a-4828-a3ce-cd1c9212413e tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lazy-loading 'services' on Instance uuid 2306113c-8f98-42fd-8c0c-3dfac98fff21 {{(pid=116273) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 22 12:24:37.458406 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-4485f110-457a-4828-a3ce-cd1c9212413e tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "DELETE /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21/os-volume_attachments/cb7a4721-8964-407a-8eb8-e7b93cdc0466" status: 202 len: 0 microversion: 2.1 time: 0.183266 Nov 22 12:24:37.459190 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 455/974] 10.222.0.66 () {58 vars in 1415 bytes} [Mon Nov 22 12:24:37 2021] DELETE /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21/os-volume_attachments/cb7a4721-8964-407a-8eb8-e7b93cdc0466 => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 22 12:24:37.816693 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-d9665f3c-7df9-40cd-a85b-9b8bf881385c tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:24:37.817767 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-d9665f3c-7df9-40cd-a85b-9b8bf881385c tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: 496ce05f-ecc0-4dfd-b1d4-1c961f763af7] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:24:37.825493 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-d9665f3c-7df9-40cd-a85b-9b8bf881385c tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:24:37.825945 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-d9665f3c-7df9-40cd-a85b-9b8bf881385c tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:24:37.826731 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-d9665f3c-7df9-40cd-a85b-9b8bf881385c tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:24:37.827320 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-d9665f3c-7df9-40cd-a85b-9b8bf881385c tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:24:37.894086 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-d9665f3c-7df9-40cd-a85b-9b8bf881385c tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "POST /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7/action" status: 200 len: 14 microversion: 2.20 time: 0.082238 Nov 22 12:24:37.894767 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 520/975] 10.222.0.66 () {62 vars in 1318 bytes} [Mon Nov 22 12:24:37 2021] POST /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7/action => generated 14 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:24:38.056926 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-cbb352a8-863b-4dee-af83-66a64730866f tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:24:38.058883 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-cbb352a8-863b-4dee-af83-66a64730866f tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] [instance: 131dcb5b-f62d-42ec-b0d0-588a120aa1d3] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:24:38.066620 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-cbb352a8-863b-4dee-af83-66a64730866f tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:24:38.067070 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-cbb352a8-863b-4dee-af83-66a64730866f tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:24:38.067992 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-cbb352a8-863b-4dee-af83-66a64730866f tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:24:38.068441 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-cbb352a8-863b-4dee-af83-66a64730866f tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:24:38.232809 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-cbb352a8-863b-4dee-af83-66a64730866f tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc2a99b8e8f244aab8bd6545355ee044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b282b4e5e2147a692e990f45ce44b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:24:38.241349 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-cbb352a8-863b-4dee-af83-66a64730866f tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] 10.222.0.66 "GET /compute/v2.1/servers/131dcb5b-f62d-42ec-b0d0-588a120aa1d3" status: 200 len: 1755 microversion: 2.1 time: 0.189234 Nov 22 12:24:38.242112 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 456/976] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:24:38 2021] GET /compute/v2.1/servers/131dcb5b-f62d-42ec-b0d0-588a120aa1d3 => generated 1755 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:24:38.572689 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-391cc48f-294a-4c54-a6fe-60d927f7c60b tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:24:38.580203 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-391cc48f-294a-4c54-a6fe-60d927f7c60b tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:24:38.580651 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-391cc48f-294a-4c54-a6fe-60d927f7c60b tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:24:38.644401 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-391cc48f-294a-4c54-a6fe-60d927f7c60b tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: 2306113c-8f98-42fd-8c0c-3dfac98fff21] Going to try to stop instance {{(pid=116272) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Nov 22 12:24:38.690216 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-391cc48f-294a-4c54-a6fe-60d927f7c60b tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "POST /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21/action" status: 202 len: 0 microversion: 2.1 time: 0.122162 Nov 22 12:24:38.690855 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 521/977] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Nov 22 12:24:38 2021] POST /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 22 12:24:38.699546 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-ec1598a2-26d8-4578-8173-134a8bc18acf tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:24:38.700253 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-ec1598a2-26d8-4578-8173-134a8bc18acf tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: 2306113c-8f98-42fd-8c0c-3dfac98fff21] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:24:38.707465 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-ec1598a2-26d8-4578-8173-134a8bc18acf tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:24:38.707917 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-ec1598a2-26d8-4578-8173-134a8bc18acf tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:24:38.708749 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-ec1598a2-26d8-4578-8173-134a8bc18acf tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:24:38.709337 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-ec1598a2-26d8-4578-8173-134a8bc18acf tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:24:38.854935 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-ec1598a2-26d8-4578-8173-134a8bc18acf tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41d885b9b854d8db11da5d325552301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f5dffe9bc3f41c7a2656d194fd02173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:24:38.862722 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-ec1598a2-26d8-4578-8173-134a8bc18acf tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "GET /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21" status: 200 len: 1677 microversion: 2.1 time: 0.167174 Nov 22 12:24:38.863313 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 457/978] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:24:38 2021] GET /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21 => generated 1677 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:24:38.906913 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-7a0dafb5-2649-4e86-9643-da0d243fd620 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:24:38.907872 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-7a0dafb5-2649-4e86-9643-da0d243fd620 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: 496ce05f-ecc0-4dfd-b1d4-1c961f763af7] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:24:38.915005 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-7a0dafb5-2649-4e86-9643-da0d243fd620 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:24:38.915485 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-7a0dafb5-2649-4e86-9643-da0d243fd620 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:24:38.916263 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-7a0dafb5-2649-4e86-9643-da0d243fd620 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:24:38.916694 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-7a0dafb5-2649-4e86-9643-da0d243fd620 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:24:38.980421 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-7a0dafb5-2649-4e86-9643-da0d243fd620 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "POST /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7/action" status: 200 len: 14 microversion: 2.20 time: 0.077888 Nov 22 12:24:38.984038 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 522/979] 10.222.0.66 () {62 vars in 1318 bytes} [Mon Nov 22 12:24:38 2021] POST /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7/action => generated 14 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:24:39.259448 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-1a043383-fc14-44db-9b11-c98fb83dca05 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:24:39.260062 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-1a043383-fc14-44db-9b11-c98fb83dca05 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] [instance: 131dcb5b-f62d-42ec-b0d0-588a120aa1d3] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:24:39.266606 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-1a043383-fc14-44db-9b11-c98fb83dca05 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:24:39.267057 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-1a043383-fc14-44db-9b11-c98fb83dca05 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:24:39.267934 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-1a043383-fc14-44db-9b11-c98fb83dca05 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:24:39.268374 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-1a043383-fc14-44db-9b11-c98fb83dca05 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:24:39.437644 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-1a043383-fc14-44db-9b11-c98fb83dca05 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc2a99b8e8f244aab8bd6545355ee044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b282b4e5e2147a692e990f45ce44b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:24:39.446552 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-1a043383-fc14-44db-9b11-c98fb83dca05 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] 10.222.0.66 "GET /compute/v2.1/servers/131dcb5b-f62d-42ec-b0d0-588a120aa1d3" status: 200 len: 1755 microversion: 2.1 time: 0.190245 Nov 22 12:24:39.447169 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 458/980] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:24:39 2021] GET /compute/v2.1/servers/131dcb5b-f62d-42ec-b0d0-588a120aa1d3 => generated 1755 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:24:39.881728 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-ec7f6c71-faf9-4232-8474-2c7427d6b725 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:24:39.882439 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-ec7f6c71-faf9-4232-8474-2c7427d6b725 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: 2306113c-8f98-42fd-8c0c-3dfac98fff21] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:24:39.890572 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-ec7f6c71-faf9-4232-8474-2c7427d6b725 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:24:39.890999 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-ec7f6c71-faf9-4232-8474-2c7427d6b725 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:24:39.891823 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-ec7f6c71-faf9-4232-8474-2c7427d6b725 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:24:39.892254 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-ec7f6c71-faf9-4232-8474-2c7427d6b725 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:24:39.991935 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-18f4b09c-3c29-4896-ac00-4304c716ed22 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:24:39.993335 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-18f4b09c-3c29-4896-ac00-4304c716ed22 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: 496ce05f-ecc0-4dfd-b1d4-1c961f763af7] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:24:39.999705 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-18f4b09c-3c29-4896-ac00-4304c716ed22 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:24:40.000144 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-18f4b09c-3c29-4896-ac00-4304c716ed22 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:24:40.000947 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-18f4b09c-3c29-4896-ac00-4304c716ed22 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:24:40.001400 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-18f4b09c-3c29-4896-ac00-4304c716ed22 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:24:40.041288 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-ec7f6c71-faf9-4232-8474-2c7427d6b725 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41d885b9b854d8db11da5d325552301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f5dffe9bc3f41c7a2656d194fd02173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:24:40.048807 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-ec7f6c71-faf9-4232-8474-2c7427d6b725 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "GET /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21" status: 200 len: 1677 microversion: 2.1 time: 0.171394 Nov 22 12:24:40.049394 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 523/981] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:24:39 2021] GET /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21 => generated 1677 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:24:40.064401 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-18f4b09c-3c29-4896-ac00-4304c716ed22 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "POST /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7/action" status: 200 len: 14 microversion: 2.20 time: 0.075983 Nov 22 12:24:40.065067 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 459/982] 10.222.0.66 () {62 vars in 1318 bytes} [Mon Nov 22 12:24:39 2021] POST /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7/action => generated 14 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:24:40.466555 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-d0ffddc3-3095-4ea0-bc9b-4e908e1a85b7 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:24:40.467253 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-d0ffddc3-3095-4ea0-bc9b-4e908e1a85b7 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] [instance: 131dcb5b-f62d-42ec-b0d0-588a120aa1d3] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:24:40.474101 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-d0ffddc3-3095-4ea0-bc9b-4e908e1a85b7 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:24:40.474544 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-d0ffddc3-3095-4ea0-bc9b-4e908e1a85b7 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:24:40.475377 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-d0ffddc3-3095-4ea0-bc9b-4e908e1a85b7 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:24:40.475830 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-d0ffddc3-3095-4ea0-bc9b-4e908e1a85b7 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:24:40.679792 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-d0ffddc3-3095-4ea0-bc9b-4e908e1a85b7 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc2a99b8e8f244aab8bd6545355ee044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b282b4e5e2147a692e990f45ce44b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:24:40.688078 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-d0ffddc3-3095-4ea0-bc9b-4e908e1a85b7 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] 10.222.0.66 "GET /compute/v2.1/servers/131dcb5b-f62d-42ec-b0d0-588a120aa1d3" status: 200 len: 1755 microversion: 2.1 time: 0.227160 Nov 22 12:24:40.688676 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 524/983] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:24:40 2021] GET /compute/v2.1/servers/131dcb5b-f62d-42ec-b0d0-588a120aa1d3 => generated 1755 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:24:41.069466 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-a0c6b835-3d6c-4796-b7c7-e69e5f77195c tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:24:41.070186 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-a0c6b835-3d6c-4796-b7c7-e69e5f77195c tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: 2306113c-8f98-42fd-8c0c-3dfac98fff21] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:24:41.075682 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-179d0b04-c9c7-47ba-a449-2430091fb793 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:24:41.077262 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-179d0b04-c9c7-47ba-a449-2430091fb793 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: 496ce05f-ecc0-4dfd-b1d4-1c961f763af7] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:24:41.077577 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-a0c6b835-3d6c-4796-b7c7-e69e5f77195c tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:24:41.078032 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-a0c6b835-3d6c-4796-b7c7-e69e5f77195c tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:24:41.078835 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-a0c6b835-3d6c-4796-b7c7-e69e5f77195c tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:24:41.079426 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-a0c6b835-3d6c-4796-b7c7-e69e5f77195c tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:24:41.086697 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-179d0b04-c9c7-47ba-a449-2430091fb793 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:24:41.087129 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-179d0b04-c9c7-47ba-a449-2430091fb793 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:24:41.087988 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-179d0b04-c9c7-47ba-a449-2430091fb793 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:24:41.088443 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-179d0b04-c9c7-47ba-a449-2430091fb793 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:24:41.153346 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-179d0b04-c9c7-47ba-a449-2430091fb793 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "POST /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7/action" status: 200 len: 14 microversion: 2.20 time: 0.080854 Nov 22 12:24:41.154956 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 525/984] 10.222.0.66 () {62 vars in 1318 bytes} [Mon Nov 22 12:24:41 2021] POST /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7/action => generated 14 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:24:41.238273 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-a0c6b835-3d6c-4796-b7c7-e69e5f77195c tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41d885b9b854d8db11da5d325552301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f5dffe9bc3f41c7a2656d194fd02173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:24:41.246379 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-a0c6b835-3d6c-4796-b7c7-e69e5f77195c tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "GET /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21" status: 200 len: 1677 microversion: 2.1 time: 0.183125 Nov 22 12:24:41.246879 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 460/985] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:24:41 2021] GET /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21 => generated 1677 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:24:41.713189 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-1d5ba048-58ed-4c6f-bd7e-b8225f208c5f tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:24:41.714158 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-1d5ba048-58ed-4c6f-bd7e-b8225f208c5f tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] [instance: 131dcb5b-f62d-42ec-b0d0-588a120aa1d3] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:24:41.721511 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-1d5ba048-58ed-4c6f-bd7e-b8225f208c5f tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:24:41.721954 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-1d5ba048-58ed-4c6f-bd7e-b8225f208c5f tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:24:41.722706 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-1d5ba048-58ed-4c6f-bd7e-b8225f208c5f tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:24:41.723137 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-1d5ba048-58ed-4c6f-bd7e-b8225f208c5f tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:24:41.881691 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-1d5ba048-58ed-4c6f-bd7e-b8225f208c5f tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc2a99b8e8f244aab8bd6545355ee044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b282b4e5e2147a692e990f45ce44b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:24:41.890715 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-1d5ba048-58ed-4c6f-bd7e-b8225f208c5f tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] 10.222.0.66 "GET /compute/v2.1/servers/131dcb5b-f62d-42ec-b0d0-588a120aa1d3" status: 200 len: 1755 microversion: 2.1 time: 0.182251 Nov 22 12:24:41.891327 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 526/986] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:24:41 2021] GET /compute/v2.1/servers/131dcb5b-f62d-42ec-b0d0-588a120aa1d3 => generated 1755 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:24:42.165355 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-e33a9bb8-87f9-44ea-8eaf-658b2eed660c tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:24:42.166316 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-e33a9bb8-87f9-44ea-8eaf-658b2eed660c tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: 496ce05f-ecc0-4dfd-b1d4-1c961f763af7] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:24:42.172821 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-e33a9bb8-87f9-44ea-8eaf-658b2eed660c tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:24:42.173276 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-e33a9bb8-87f9-44ea-8eaf-658b2eed660c tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:24:42.174058 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-e33a9bb8-87f9-44ea-8eaf-658b2eed660c tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:24:42.174491 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-e33a9bb8-87f9-44ea-8eaf-658b2eed660c tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:24:42.243746 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-e33a9bb8-87f9-44ea-8eaf-658b2eed660c tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "POST /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7/action" status: 200 len: 14 microversion: 2.20 time: 0.081649 Nov 22 12:24:42.244867 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 461/987] 10.222.0.66 () {62 vars in 1318 bytes} [Mon Nov 22 12:24:42 2021] POST /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7/action => generated 14 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:24:42.263969 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-9ed7e442-7464-4260-8448-ddd3ef70f667 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:24:42.264485 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-9ed7e442-7464-4260-8448-ddd3ef70f667 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: 2306113c-8f98-42fd-8c0c-3dfac98fff21] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:24:42.270834 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-9ed7e442-7464-4260-8448-ddd3ef70f667 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:24:42.271314 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-9ed7e442-7464-4260-8448-ddd3ef70f667 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:24:42.272097 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-9ed7e442-7464-4260-8448-ddd3ef70f667 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:24:42.272563 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-9ed7e442-7464-4260-8448-ddd3ef70f667 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:24:42.412273 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-9ed7e442-7464-4260-8448-ddd3ef70f667 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41d885b9b854d8db11da5d325552301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f5dffe9bc3f41c7a2656d194fd02173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:24:42.420866 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-9ed7e442-7464-4260-8448-ddd3ef70f667 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "GET /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21" status: 200 len: 1677 microversion: 2.1 time: 0.160559 Nov 22 12:24:42.421437 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 527/988] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:24:42 2021] GET /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21 => generated 1677 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:24:42.909512 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-03eb3dee-eb61-4495-80be-0dd57a34b612 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:24:42.910310 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-03eb3dee-eb61-4495-80be-0dd57a34b612 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] [instance: 131dcb5b-f62d-42ec-b0d0-588a120aa1d3] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:24:42.917444 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-03eb3dee-eb61-4495-80be-0dd57a34b612 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:24:42.917959 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-03eb3dee-eb61-4495-80be-0dd57a34b612 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:24:42.918808 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-03eb3dee-eb61-4495-80be-0dd57a34b612 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:24:42.919327 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-03eb3dee-eb61-4495-80be-0dd57a34b612 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:24:43.072557 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-03eb3dee-eb61-4495-80be-0dd57a34b612 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc2a99b8e8f244aab8bd6545355ee044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b282b4e5e2147a692e990f45ce44b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:24:43.081169 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-03eb3dee-eb61-4495-80be-0dd57a34b612 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] 10.222.0.66 "GET /compute/v2.1/servers/131dcb5b-f62d-42ec-b0d0-588a120aa1d3" status: 200 len: 1755 microversion: 2.1 time: 0.175645 Nov 22 12:24:43.081503 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 462/989] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:24:42 2021] GET /compute/v2.1/servers/131dcb5b-f62d-42ec-b0d0-588a120aa1d3 => generated 1755 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:24:43.255532 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-ca53f84e-8855-4bb8-9845-82203e206600 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:24:43.256463 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-ca53f84e-8855-4bb8-9845-82203e206600 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: 496ce05f-ecc0-4dfd-b1d4-1c961f763af7] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:24:43.263800 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-ca53f84e-8855-4bb8-9845-82203e206600 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:24:43.264379 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-ca53f84e-8855-4bb8-9845-82203e206600 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:24:43.265309 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-ca53f84e-8855-4bb8-9845-82203e206600 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:24:43.265840 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-ca53f84e-8855-4bb8-9845-82203e206600 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:24:43.336714 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-ca53f84e-8855-4bb8-9845-82203e206600 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "POST /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7/action" status: 200 len: 14 microversion: 2.20 time: 0.084766 Nov 22 12:24:43.340321 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 528/990] 10.222.0.66 () {62 vars in 1318 bytes} [Mon Nov 22 12:24:43 2021] POST /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7/action => generated 14 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:24:43.438652 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-10b711f6-3bc0-4179-b8df-c995c6d2018a tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:24:43.439209 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-10b711f6-3bc0-4179-b8df-c995c6d2018a tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: 2306113c-8f98-42fd-8c0c-3dfac98fff21] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:24:43.445949 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-10b711f6-3bc0-4179-b8df-c995c6d2018a tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:24:43.446552 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-10b711f6-3bc0-4179-b8df-c995c6d2018a tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:24:43.447748 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-10b711f6-3bc0-4179-b8df-c995c6d2018a tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:24:43.448305 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-10b711f6-3bc0-4179-b8df-c995c6d2018a tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:24:43.606055 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-10b711f6-3bc0-4179-b8df-c995c6d2018a tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41d885b9b854d8db11da5d325552301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f5dffe9bc3f41c7a2656d194fd02173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:24:43.614072 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-10b711f6-3bc0-4179-b8df-c995c6d2018a tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "GET /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21" status: 200 len: 1677 microversion: 2.1 time: 0.179570 Nov 22 12:24:43.614633 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 463/991] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:24:43 2021] GET /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21 => generated 1677 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:24:44.099887 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-db1a7859-e0f8-4582-80c4-2fca4fed4675 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:24:44.100619 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-db1a7859-e0f8-4582-80c4-2fca4fed4675 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] [instance: 131dcb5b-f62d-42ec-b0d0-588a120aa1d3] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:24:44.108083 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-db1a7859-e0f8-4582-80c4-2fca4fed4675 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:24:44.108765 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-db1a7859-e0f8-4582-80c4-2fca4fed4675 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:24:44.109784 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-db1a7859-e0f8-4582-80c4-2fca4fed4675 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:24:44.110440 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-db1a7859-e0f8-4582-80c4-2fca4fed4675 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:24:44.266341 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-db1a7859-e0f8-4582-80c4-2fca4fed4675 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc2a99b8e8f244aab8bd6545355ee044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b282b4e5e2147a692e990f45ce44b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:24:44.277206 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-db1a7859-e0f8-4582-80c4-2fca4fed4675 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] 10.222.0.66 "GET /compute/v2.1/servers/131dcb5b-f62d-42ec-b0d0-588a120aa1d3" status: 200 len: 1755 microversion: 2.1 time: 0.182056 Nov 22 12:24:44.278149 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 529/992] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:24:44 2021] GET /compute/v2.1/servers/131dcb5b-f62d-42ec-b0d0-588a120aa1d3 => generated 1755 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:24:44.350734 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-63dd0a5a-76d9-4a63-9e15-f835a8e95d19 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:24:44.351904 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-63dd0a5a-76d9-4a63-9e15-f835a8e95d19 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: 496ce05f-ecc0-4dfd-b1d4-1c961f763af7] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:24:44.361275 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-63dd0a5a-76d9-4a63-9e15-f835a8e95d19 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:24:44.361728 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-63dd0a5a-76d9-4a63-9e15-f835a8e95d19 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:24:44.362792 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-63dd0a5a-76d9-4a63-9e15-f835a8e95d19 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:24:44.363349 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-63dd0a5a-76d9-4a63-9e15-f835a8e95d19 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:24:44.428673 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-63dd0a5a-76d9-4a63-9e15-f835a8e95d19 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "POST /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7/action" status: 200 len: 14 microversion: 2.20 time: 0.083857 Nov 22 12:24:44.429293 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 464/993] 10.222.0.66 () {62 vars in 1318 bytes} [Mon Nov 22 12:24:44 2021] POST /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7/action => generated 14 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:24:44.632453 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-5f76b3c0-a775-4005-9f2f-a90916f36eb4 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:24:44.633057 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-5f76b3c0-a775-4005-9f2f-a90916f36eb4 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: 2306113c-8f98-42fd-8c0c-3dfac98fff21] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:24:44.640209 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-5f76b3c0-a775-4005-9f2f-a90916f36eb4 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:24:44.640655 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-5f76b3c0-a775-4005-9f2f-a90916f36eb4 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:24:44.641438 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-5f76b3c0-a775-4005-9f2f-a90916f36eb4 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:24:44.641870 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-5f76b3c0-a775-4005-9f2f-a90916f36eb4 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:24:44.784668 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-5f76b3c0-a775-4005-9f2f-a90916f36eb4 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41d885b9b854d8db11da5d325552301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f5dffe9bc3f41c7a2656d194fd02173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:24:44.793000 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-5f76b3c0-a775-4005-9f2f-a90916f36eb4 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "GET /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21" status: 200 len: 1677 microversion: 2.1 time: 0.164078 Nov 22 12:24:44.793586 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 530/994] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:24:44 2021] GET /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21 => generated 1677 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 12:24:45.301629 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-508e3175-5938-470d-9563-689e2421d3b5 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:24:45.302426 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-508e3175-5938-470d-9563-689e2421d3b5 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] [instance: 131dcb5b-f62d-42ec-b0d0-588a120aa1d3] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:24:45.310055 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-508e3175-5938-470d-9563-689e2421d3b5 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:24:45.310565 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-508e3175-5938-470d-9563-689e2421d3b5 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:24:45.311411 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-508e3175-5938-470d-9563-689e2421d3b5 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:24:45.311847 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-508e3175-5938-470d-9563-689e2421d3b5 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:24:45.440504 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-d259af55-a2dd-4df6-b66a-00645bbab165 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:24:45.442199 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-d259af55-a2dd-4df6-b66a-00645bbab165 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: 496ce05f-ecc0-4dfd-b1d4-1c961f763af7] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:24:45.459659 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-d259af55-a2dd-4df6-b66a-00645bbab165 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:24:45.460126 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-d259af55-a2dd-4df6-b66a-00645bbab165 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:24:45.460995 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-d259af55-a2dd-4df6-b66a-00645bbab165 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:24:45.461512 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-d259af55-a2dd-4df6-b66a-00645bbab165 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:24:45.473318 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-508e3175-5938-470d-9563-689e2421d3b5 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc2a99b8e8f244aab8bd6545355ee044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b282b4e5e2147a692e990f45ce44b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:24:45.481848 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-508e3175-5938-470d-9563-689e2421d3b5 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] 10.222.0.66 "GET /compute/v2.1/servers/131dcb5b-f62d-42ec-b0d0-588a120aa1d3" status: 200 len: 1758 microversion: 2.1 time: 0.184156 Nov 22 12:24:45.482443 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 465/995] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:24:45 2021] GET /compute/v2.1/servers/131dcb5b-f62d-42ec-b0d0-588a120aa1d3 => generated 1758 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:24:45.552855 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-d259af55-a2dd-4df6-b66a-00645bbab165 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "POST /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7/action" status: 200 len: 9847 microversion: 2.20 time: 0.116259 Nov 22 12:24:45.553562 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 531/996] 10.222.0.66 () {62 vars in 1318 bytes} [Mon Nov 22 12:24:45 2021] POST /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7/action => generated 9847 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 22 12:24:45.813544 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-44da38b2-84e0-49b9-8ed3-e0d38f66203e tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:24:45.814159 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-44da38b2-84e0-49b9-8ed3-e0d38f66203e tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: 2306113c-8f98-42fd-8c0c-3dfac98fff21] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:24:45.824486 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-44da38b2-84e0-49b9-8ed3-e0d38f66203e tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:24:45.824919 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-44da38b2-84e0-49b9-8ed3-e0d38f66203e tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:24:45.825761 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-44da38b2-84e0-49b9-8ed3-e0d38f66203e tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:24:45.826270 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-44da38b2-84e0-49b9-8ed3-e0d38f66203e tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:24:45.966094 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-44da38b2-84e0-49b9-8ed3-e0d38f66203e tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41d885b9b854d8db11da5d325552301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f5dffe9bc3f41c7a2656d194fd02173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:24:45.974208 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-44da38b2-84e0-49b9-8ed3-e0d38f66203e tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "GET /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21" status: 200 len: 1677 microversion: 2.1 time: 0.164828 Nov 22 12:24:45.974785 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 466/997] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:24:45 2021] GET /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21 => generated 1677 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:24:46.565721 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-2c3201b9-a8d4-4468-9406-83a2b5a93eb5 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:24:46.566698 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-2c3201b9-a8d4-4468-9406-83a2b5a93eb5 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: 496ce05f-ecc0-4dfd-b1d4-1c961f763af7] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:24:46.574551 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-2c3201b9-a8d4-4468-9406-83a2b5a93eb5 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:24:46.574997 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-2c3201b9-a8d4-4468-9406-83a2b5a93eb5 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:24:46.575809 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-2c3201b9-a8d4-4468-9406-83a2b5a93eb5 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:24:46.576247 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-2c3201b9-a8d4-4468-9406-83a2b5a93eb5 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:24:46.650172 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-2c3201b9-a8d4-4468-9406-83a2b5a93eb5 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "POST /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7/action" status: 200 len: 17000 microversion: 2.20 time: 0.088338 Nov 22 12:24:46.650853 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 532/998] 10.222.0.66 () {62 vars in 1318 bytes} [Mon Nov 22 12:24:46 2021] POST /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7/action => generated 17000 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 12:24:46.992763 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-711ae15d-df8f-4c49-96de-403871597b85 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:24:46.993401 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-711ae15d-df8f-4c49-96de-403871597b85 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: 2306113c-8f98-42fd-8c0c-3dfac98fff21] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:24:47.000740 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-711ae15d-df8f-4c49-96de-403871597b85 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:24:47.001189 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-711ae15d-df8f-4c49-96de-403871597b85 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:24:47.001964 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-711ae15d-df8f-4c49-96de-403871597b85 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:24:47.002391 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-711ae15d-df8f-4c49-96de-403871597b85 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:24:47.148913 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-711ae15d-df8f-4c49-96de-403871597b85 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41d885b9b854d8db11da5d325552301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f5dffe9bc3f41c7a2656d194fd02173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:24:47.158189 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-711ae15d-df8f-4c49-96de-403871597b85 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "GET /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21" status: 200 len: 1677 microversion: 2.1 time: 0.169449 Nov 22 12:24:47.158741 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 467/999] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:24:46 2021] GET /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21 => generated 1677 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:24:47.665769 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-67d881b7-1d38-46a5-8aa6-4069c65131af tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:24:47.666782 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-67d881b7-1d38-46a5-8aa6-4069c65131af tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: 496ce05f-ecc0-4dfd-b1d4-1c961f763af7] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:24:47.674042 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-67d881b7-1d38-46a5-8aa6-4069c65131af tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:24:47.674507 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-67d881b7-1d38-46a5-8aa6-4069c65131af tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:24:47.675267 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-67d881b7-1d38-46a5-8aa6-4069c65131af tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:24:47.675723 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-67d881b7-1d38-46a5-8aa6-4069c65131af tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:24:47.748285 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-67d881b7-1d38-46a5-8aa6-4069c65131af tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "POST /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7/action" status: 200 len: 18498 microversion: 2.20 time: 0.087431 Nov 22 12:24:47.748485 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 533/1000] 10.222.0.66 () {62 vars in 1318 bytes} [Mon Nov 22 12:24:47 2021] POST /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7/action => generated 18498 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 12:24:48.176051 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-add0556b-2331-492f-84b9-c8bfdd8fca20 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:24:48.176733 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-add0556b-2331-492f-84b9-c8bfdd8fca20 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: 2306113c-8f98-42fd-8c0c-3dfac98fff21] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:24:48.183693 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-add0556b-2331-492f-84b9-c8bfdd8fca20 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:24:48.184142 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-add0556b-2331-492f-84b9-c8bfdd8fca20 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:24:48.184989 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-add0556b-2331-492f-84b9-c8bfdd8fca20 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:24:48.185509 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-add0556b-2331-492f-84b9-c8bfdd8fca20 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:24:48.316725 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-add0556b-2331-492f-84b9-c8bfdd8fca20 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41d885b9b854d8db11da5d325552301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f5dffe9bc3f41c7a2656d194fd02173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:24:48.327485 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-add0556b-2331-492f-84b9-c8bfdd8fca20 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "GET /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21" status: 200 len: 1677 microversion: 2.1 time: 0.155128 Nov 22 12:24:48.328320 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 468/1001] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:24:48 2021] GET /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21 => generated 1677 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:24:48.760527 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-c2a6d75b-bc72-418c-a7f9-10e365c4f60f tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:24:48.761537 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-c2a6d75b-bc72-418c-a7f9-10e365c4f60f tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: 496ce05f-ecc0-4dfd-b1d4-1c961f763af7] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:24:48.768757 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-c2a6d75b-bc72-418c-a7f9-10e365c4f60f tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:24:48.769208 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-c2a6d75b-bc72-418c-a7f9-10e365c4f60f tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:24:48.770025 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-c2a6d75b-bc72-418c-a7f9-10e365c4f60f tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:24:48.770461 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-c2a6d75b-bc72-418c-a7f9-10e365c4f60f tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:24:48.848178 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-c2a6d75b-bc72-418c-a7f9-10e365c4f60f tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "POST /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7/action" status: 200 len: 20997 microversion: 2.20 time: 0.091871 Nov 22 12:24:48.848832 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 534/1002] 10.222.0.66 () {62 vars in 1318 bytes} [Mon Nov 22 12:24:48 2021] POST /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7/action => generated 20997 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 12:24:49.345275 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-81aae4ee-dc82-455e-a70f-abb8e6b5b7d0 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:24:49.345898 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-81aae4ee-dc82-455e-a70f-abb8e6b5b7d0 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: 2306113c-8f98-42fd-8c0c-3dfac98fff21] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:24:49.352353 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-81aae4ee-dc82-455e-a70f-abb8e6b5b7d0 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:24:49.352800 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-81aae4ee-dc82-455e-a70f-abb8e6b5b7d0 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:24:49.353772 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-81aae4ee-dc82-455e-a70f-abb8e6b5b7d0 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:24:49.354054 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-81aae4ee-dc82-455e-a70f-abb8e6b5b7d0 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:24:49.506676 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-81aae4ee-dc82-455e-a70f-abb8e6b5b7d0 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41d885b9b854d8db11da5d325552301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f5dffe9bc3f41c7a2656d194fd02173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:24:49.516872 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-81aae4ee-dc82-455e-a70f-abb8e6b5b7d0 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "GET /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21" status: 200 len: 1654 microversion: 2.1 time: 0.174963 Nov 22 12:24:49.522843 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 469/1003] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:24:49 2021] GET /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21 => generated 1654 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 12:24:49.536735 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-c9b6a44f-af1e-44d7-8bf4-d7947cb35324 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:24:49.546847 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-c9b6a44f-af1e-44d7-8bf4-d7947cb35324 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:24:49.547208 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-c9b6a44f-af1e-44d7-8bf4-d7947cb35324 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:24:49.576938 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-c9b6a44f-af1e-44d7-8bf4-d7947cb35324 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: 2306113c-8f98-42fd-8c0c-3dfac98fff21] Going to try to start instance {{(pid=116272) start /opt/stack/nova/nova/compute/api.py:2677}} Nov 22 12:24:49.622644 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-c9b6a44f-af1e-44d7-8bf4-d7947cb35324 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "POST /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21/action" status: 202 len: 0 microversion: 2.1 time: 0.091323 Nov 22 12:24:49.623652 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 535/1004] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Nov 22 12:24:49 2021] POST /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 22 12:24:49.632241 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-2d197eb4-77d0-4d58-b231-6b8dd86a9927 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:24:49.632945 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-2d197eb4-77d0-4d58-b231-6b8dd86a9927 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: 2306113c-8f98-42fd-8c0c-3dfac98fff21] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:24:49.641817 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-2d197eb4-77d0-4d58-b231-6b8dd86a9927 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:24:49.642267 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-2d197eb4-77d0-4d58-b231-6b8dd86a9927 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:24:49.643068 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-2d197eb4-77d0-4d58-b231-6b8dd86a9927 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:24:49.643536 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-2d197eb4-77d0-4d58-b231-6b8dd86a9927 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:24:49.863838 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-469ea695-ef4c-46b9-8be1-b34697a5c02e tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:24:49.864807 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-469ea695-ef4c-46b9-8be1-b34697a5c02e tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: 496ce05f-ecc0-4dfd-b1d4-1c961f763af7] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:24:49.871933 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-469ea695-ef4c-46b9-8be1-b34697a5c02e tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:24:49.872719 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-469ea695-ef4c-46b9-8be1-b34697a5c02e tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:24:49.873578 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-469ea695-ef4c-46b9-8be1-b34697a5c02e tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:24:49.874041 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-469ea695-ef4c-46b9-8be1-b34697a5c02e tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:24:49.921921 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-2d197eb4-77d0-4d58-b231-6b8dd86a9927 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41d885b9b854d8db11da5d325552301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f5dffe9bc3f41c7a2656d194fd02173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:24:49.930382 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-2d197eb4-77d0-4d58-b231-6b8dd86a9927 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "GET /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21" status: 200 len: 1663 microversion: 2.1 time: 0.302190 Nov 22 12:24:49.931279 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 470/1005] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:24:49 2021] GET /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21 => generated 1663 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:24:49.953066 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-469ea695-ef4c-46b9-8be1-b34697a5c02e tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "POST /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7/action" status: 200 len: 22981 microversion: 2.20 time: 0.094243 Nov 22 12:24:49.953716 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 536/1006] 10.222.0.66 () {62 vars in 1318 bytes} [Mon Nov 22 12:24:49 2021] POST /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7/action => generated 22981 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 22 12:24:50.951439 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-9be1fd20-7da7-449c-8135-fd76d1542f9b tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:24:50.952959 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-9be1fd20-7da7-449c-8135-fd76d1542f9b tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: 2306113c-8f98-42fd-8c0c-3dfac98fff21] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:24:50.961347 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-9be1fd20-7da7-449c-8135-fd76d1542f9b tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:24:50.962119 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-9be1fd20-7da7-449c-8135-fd76d1542f9b tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:24:50.964040 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-9be1fd20-7da7-449c-8135-fd76d1542f9b tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:24:50.964721 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-9be1fd20-7da7-449c-8135-fd76d1542f9b tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:24:50.965527 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-40f7065c-cb8d-423c-aef9-5c6628157517 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:24:50.966587 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-40f7065c-cb8d-423c-aef9-5c6628157517 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: 496ce05f-ecc0-4dfd-b1d4-1c961f763af7] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:24:50.974154 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-40f7065c-cb8d-423c-aef9-5c6628157517 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:24:50.975269 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-40f7065c-cb8d-423c-aef9-5c6628157517 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:24:50.976299 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-40f7065c-cb8d-423c-aef9-5c6628157517 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:24:50.976926 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-40f7065c-cb8d-423c-aef9-5c6628157517 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:24:51.058614 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-40f7065c-cb8d-423c-aef9-5c6628157517 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "POST /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7/action" status: 200 len: 23804 microversion: 2.20 time: 0.097320 Nov 22 12:24:51.059856 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 537/1007] 10.222.0.66 () {62 vars in 1318 bytes} [Mon Nov 22 12:24:50 2021] POST /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7/action => generated 23804 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 22 12:24:51.123867 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-9be1fd20-7da7-449c-8135-fd76d1542f9b tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41d885b9b854d8db11da5d325552301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f5dffe9bc3f41c7a2656d194fd02173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:24:51.131197 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-9be1fd20-7da7-449c-8135-fd76d1542f9b tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "GET /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21" status: 200 len: 1667 microversion: 2.1 time: 0.186026 Nov 22 12:24:51.132074 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 471/1008] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:24:50 2021] GET /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21 => generated 1667 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:24:52.071119 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-31221c82-585c-4dc2-86b5-2511a89dacc2 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:24:52.072397 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-31221c82-585c-4dc2-86b5-2511a89dacc2 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: 496ce05f-ecc0-4dfd-b1d4-1c961f763af7] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:24:52.079627 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-31221c82-585c-4dc2-86b5-2511a89dacc2 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:24:52.080154 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-31221c82-585c-4dc2-86b5-2511a89dacc2 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:24:52.081009 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-31221c82-585c-4dc2-86b5-2511a89dacc2 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:24:52.081488 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-31221c82-585c-4dc2-86b5-2511a89dacc2 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:24:52.163412 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-31221c82-585c-4dc2-86b5-2511a89dacc2 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "POST /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7/action" status: 200 len: 25649 microversion: 2.20 time: 0.096259 Nov 22 12:24:52.164721 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 538/1009] 10.222.0.66 () {62 vars in 1318 bytes} [Mon Nov 22 12:24:52 2021] POST /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7/action => generated 25649 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 22 12:24:53.175745 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-10cf97c9-f2f0-46d0-bc49-fd720d154990 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:24:53.176659 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-10cf97c9-f2f0-46d0-bc49-fd720d154990 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: 496ce05f-ecc0-4dfd-b1d4-1c961f763af7] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:24:53.183528 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-10cf97c9-f2f0-46d0-bc49-fd720d154990 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:24:53.183979 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-10cf97c9-f2f0-46d0-bc49-fd720d154990 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:24:53.184744 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-10cf97c9-f2f0-46d0-bc49-fd720d154990 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:24:53.185182 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-10cf97c9-f2f0-46d0-bc49-fd720d154990 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:24:53.270131 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-10cf97c9-f2f0-46d0-bc49-fd720d154990 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "POST /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7/action" status: 200 len: 26966 microversion: 2.20 time: 0.097889 Nov 22 12:24:53.270670 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 472/1010] 10.222.0.66 () {62 vars in 1318 bytes} [Mon Nov 22 12:24:53 2021] POST /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7/action => generated 26966 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 12:24:54.284228 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-ed720c72-84a2-4ca4-8793-e0c8baa26fbd tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:24:54.285231 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-ed720c72-84a2-4ca4-8793-e0c8baa26fbd tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: 496ce05f-ecc0-4dfd-b1d4-1c961f763af7] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:24:54.294069 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-ed720c72-84a2-4ca4-8793-e0c8baa26fbd tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:24:54.294515 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-ed720c72-84a2-4ca4-8793-e0c8baa26fbd tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:24:54.299982 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-ed720c72-84a2-4ca4-8793-e0c8baa26fbd tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:24:54.300377 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-ed720c72-84a2-4ca4-8793-e0c8baa26fbd tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:24:54.381078 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-ed720c72-84a2-4ca4-8793-e0c8baa26fbd tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "POST /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7/action" status: 200 len: 27650 microversion: 2.20 time: 0.101864 Nov 22 12:24:54.382398 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 539/1011] 10.222.0.66 () {62 vars in 1318 bytes} [Mon Nov 22 12:24:54 2021] POST /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7/action => generated 27650 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 22 12:24:55.395896 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-53d2ecad-8d87-4ffc-a7b2-e7e01ba8b7ad tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:24:55.397235 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-53d2ecad-8d87-4ffc-a7b2-e7e01ba8b7ad tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: 496ce05f-ecc0-4dfd-b1d4-1c961f763af7] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:24:55.405923 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-53d2ecad-8d87-4ffc-a7b2-e7e01ba8b7ad tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:24:55.406438 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-53d2ecad-8d87-4ffc-a7b2-e7e01ba8b7ad tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:24:55.407438 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-53d2ecad-8d87-4ffc-a7b2-e7e01ba8b7ad tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:24:55.408022 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-53d2ecad-8d87-4ffc-a7b2-e7e01ba8b7ad tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:24:55.500538 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-53d2ecad-8d87-4ffc-a7b2-e7e01ba8b7ad tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "POST /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7/action" status: 200 len: 28053 microversion: 2.20 time: 0.109988 Nov 22 12:24:55.501234 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 473/1012] 10.222.0.66 () {62 vars in 1318 bytes} [Mon Nov 22 12:24:55 2021] POST /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7/action => generated 28053 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 12:24:56.513882 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-15533674-c881-4ade-b3de-b23eaba7c3a0 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:24:56.514913 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-15533674-c881-4ade-b3de-b23eaba7c3a0 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: 496ce05f-ecc0-4dfd-b1d4-1c961f763af7] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:24:56.522099 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-15533674-c881-4ade-b3de-b23eaba7c3a0 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:24:56.522541 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-15533674-c881-4ade-b3de-b23eaba7c3a0 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:24:56.523359 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-15533674-c881-4ade-b3de-b23eaba7c3a0 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:24:56.523788 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-15533674-c881-4ade-b3de-b23eaba7c3a0 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:24:56.602543 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-15533674-c881-4ade-b3de-b23eaba7c3a0 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "POST /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7/action" status: 200 len: 28197 microversion: 2.20 time: 0.092791 Nov 22 12:24:56.603256 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 540/1013] 10.222.0.66 () {62 vars in 1318 bytes} [Mon Nov 22 12:24:56 2021] POST /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7/action => generated 28197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 12:24:57.617474 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-abe840a7-5689-4643-9435-ddca8cca6f87 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:24:57.618733 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-abe840a7-5689-4643-9435-ddca8cca6f87 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: 496ce05f-ecc0-4dfd-b1d4-1c961f763af7] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:24:57.626899 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-abe840a7-5689-4643-9435-ddca8cca6f87 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:24:57.627374 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-abe840a7-5689-4643-9435-ddca8cca6f87 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:24:57.628156 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-abe840a7-5689-4643-9435-ddca8cca6f87 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:24:57.628717 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-abe840a7-5689-4643-9435-ddca8cca6f87 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:24:57.712303 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-abe840a7-5689-4643-9435-ddca8cca6f87 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "POST /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7/action" status: 200 len: 28488 microversion: 2.20 time: 0.099721 Nov 22 12:24:57.712979 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 474/1014] 10.222.0.66 () {62 vars in 1318 bytes} [Mon Nov 22 12:24:57 2021] POST /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7/action => generated 28488 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 12:24:58.725592 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-4e5c07b4-b112-44cb-ac44-f25ce9f460f6 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:24:58.726649 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-4e5c07b4-b112-44cb-ac44-f25ce9f460f6 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: 496ce05f-ecc0-4dfd-b1d4-1c961f763af7] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:24:58.733586 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-4e5c07b4-b112-44cb-ac44-f25ce9f460f6 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:24:58.734260 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-4e5c07b4-b112-44cb-ac44-f25ce9f460f6 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:24:58.734803 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-4e5c07b4-b112-44cb-ac44-f25ce9f460f6 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:24:58.735221 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-4e5c07b4-b112-44cb-ac44-f25ce9f460f6 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:24:58.825279 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-4e5c07b4-b112-44cb-ac44-f25ce9f460f6 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "POST /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7/action" status: 200 len: 28656 microversion: 2.20 time: 0.103698 Nov 22 12:24:58.825928 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 541/1015] 10.222.0.66 () {62 vars in 1318 bytes} [Mon Nov 22 12:24:58 2021] POST /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7/action => generated 28656 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 12:24:59.838395 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-1359ffc4-9c19-4667-98b8-38866df2768d tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:24:59.839283 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-1359ffc4-9c19-4667-98b8-38866df2768d tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: 496ce05f-ecc0-4dfd-b1d4-1c961f763af7] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:24:59.847039 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-1359ffc4-9c19-4667-98b8-38866df2768d tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:24:59.847571 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-1359ffc4-9c19-4667-98b8-38866df2768d tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:24:59.848343 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-1359ffc4-9c19-4667-98b8-38866df2768d tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:24:59.848773 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-1359ffc4-9c19-4667-98b8-38866df2768d tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:24:59.915505 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-1359ffc4-9c19-4667-98b8-38866df2768d tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "POST /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7/action" status: 200 len: 28656 microversion: 2.20 time: 0.081063 Nov 22 12:24:59.916323 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 475/1016] 10.222.0.66 () {62 vars in 1318 bytes} [Mon Nov 22 12:24:59 2021] POST /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7/action => generated 28656 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 12:25:00.928656 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-1aca92d8-f72d-4c53-bcc1-7fbe957e10e2 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:25:00.929560 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-1aca92d8-f72d-4c53-bcc1-7fbe957e10e2 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: 496ce05f-ecc0-4dfd-b1d4-1c961f763af7] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:25:00.937209 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-1aca92d8-f72d-4c53-bcc1-7fbe957e10e2 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:00.937666 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-1aca92d8-f72d-4c53-bcc1-7fbe957e10e2 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:00.938447 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-1aca92d8-f72d-4c53-bcc1-7fbe957e10e2 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:00.938884 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-1aca92d8-f72d-4c53-bcc1-7fbe957e10e2 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:01.027916 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-1aca92d8-f72d-4c53-bcc1-7fbe957e10e2 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "POST /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7/action" status: 200 len: 28656 microversion: 2.20 time: 0.102852 Nov 22 12:25:01.028570 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 542/1017] 10.222.0.66 () {62 vars in 1318 bytes} [Mon Nov 22 12:25:00 2021] POST /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7/action => generated 28656 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 12:25:02.040558 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-2fdc6a71-349e-4ac4-ac09-bcfcf79c065f tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:25:02.041553 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-2fdc6a71-349e-4ac4-ac09-bcfcf79c065f tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: 496ce05f-ecc0-4dfd-b1d4-1c961f763af7] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:25:02.048864 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-2fdc6a71-349e-4ac4-ac09-bcfcf79c065f tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:02.049313 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-2fdc6a71-349e-4ac4-ac09-bcfcf79c065f tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:02.050093 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-2fdc6a71-349e-4ac4-ac09-bcfcf79c065f tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:02.050515 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-2fdc6a71-349e-4ac4-ac09-bcfcf79c065f tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:02.122124 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-2fdc6a71-349e-4ac4-ac09-bcfcf79c065f tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "POST /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7/action" status: 200 len: 28656 microversion: 2.20 time: 0.085423 Nov 22 12:25:02.122774 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 476/1018] 10.222.0.66 () {62 vars in 1318 bytes} [Mon Nov 22 12:25:02 2021] POST /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7/action => generated 28656 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 12:25:03.134831 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-1afb512c-e034-4783-a447-d61d62bdaaef tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:25:03.135751 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-1afb512c-e034-4783-a447-d61d62bdaaef tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: 496ce05f-ecc0-4dfd-b1d4-1c961f763af7] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:25:03.144079 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-1afb512c-e034-4783-a447-d61d62bdaaef tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:03.144686 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-1afb512c-e034-4783-a447-d61d62bdaaef tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:03.145491 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-1afb512c-e034-4783-a447-d61d62bdaaef tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:03.145932 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-1afb512c-e034-4783-a447-d61d62bdaaef tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:03.238931 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-1afb512c-e034-4783-a447-d61d62bdaaef tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "POST /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7/action" status: 200 len: 29586 microversion: 2.20 time: 0.108147 Nov 22 12:25:03.239635 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 543/1019] 10.222.0.66 () {62 vars in 1318 bytes} [Mon Nov 22 12:25:03 2021] POST /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7/action => generated 29586 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 12:25:04.252719 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-bdeaae09-72d8-41fb-b5ea-f110965edb68 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:25:04.253813 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-bdeaae09-72d8-41fb-b5ea-f110965edb68 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: 496ce05f-ecc0-4dfd-b1d4-1c961f763af7] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:25:04.261570 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-bdeaae09-72d8-41fb-b5ea-f110965edb68 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:04.262304 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-bdeaae09-72d8-41fb-b5ea-f110965edb68 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:04.263092 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-bdeaae09-72d8-41fb-b5ea-f110965edb68 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:04.263587 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-bdeaae09-72d8-41fb-b5ea-f110965edb68 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:04.353074 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-bdeaae09-72d8-41fb-b5ea-f110965edb68 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "POST /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7/action" status: 200 len: 31274 microversion: 2.20 time: 0.104647 Nov 22 12:25:04.353729 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 477/1020] 10.222.0.66 () {62 vars in 1318 bytes} [Mon Nov 22 12:25:04 2021] POST /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7/action => generated 31274 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 12:25:04.465865 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-14d84000-fb09-4b55-8e77-f5c4675a948a tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:25:04.466529 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-14d84000-fb09-4b55-8e77-f5c4675a948a tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] [instance: 10e112a7-d70a-4499-8be4-fd5e4ab3ec17] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:25:04.476626 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-14d84000-fb09-4b55-8e77-f5c4675a948a tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:04.477137 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-14d84000-fb09-4b55-8e77-f5c4675a948a tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:04.480747 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-14d84000-fb09-4b55-8e77-f5c4675a948a tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:04.481470 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-14d84000-fb09-4b55-8e77-f5c4675a948a tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:04.507123 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.objects.instance [None req-14d84000-fb09-4b55-8e77-f5c4675a948a tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Lazy-loading 'flavor' on Instance uuid 10e112a7-d70a-4499-8be4-fd5e4ab3ec17 {{(pid=116272) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 22 12:25:04.583917 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-14d84000-fb09-4b55-8e77-f5c4675a948a tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] 10.222.0.66 "POST /compute/v2.1/servers/10e112a7-d70a-4499-8be4-fd5e4ab3ec17/action" status: 202 len: 0 microversion: 2.1 time: 0.124298 Nov 22 12:25:04.584701 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 544/1021] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Nov 22 12:25:04 2021] POST /compute/v2.1/servers/10e112a7-d70a-4499-8be4-fd5e4ab3ec17/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 22 12:25:04.594504 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-51076d15-a11a-4e66-9f0f-b6f73312b5eb tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:25:04.595206 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-51076d15-a11a-4e66-9f0f-b6f73312b5eb tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] [instance: 10e112a7-d70a-4499-8be4-fd5e4ab3ec17] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:25:04.602455 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-51076d15-a11a-4e66-9f0f-b6f73312b5eb tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:04.602955 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-51076d15-a11a-4e66-9f0f-b6f73312b5eb tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:04.603943 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-51076d15-a11a-4e66-9f0f-b6f73312b5eb tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:04.604430 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-51076d15-a11a-4e66-9f0f-b6f73312b5eb tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:04.747032 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-51076d15-a11a-4e66-9f0f-b6f73312b5eb tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c15e2c2fa94be8b638f2257efb5820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575f4ae5262e4930b6658095a1aa8a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:25:04.758102 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-51076d15-a11a-4e66-9f0f-b6f73312b5eb tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] 10.222.0.66 "GET /compute/v2.1/servers/10e112a7-d70a-4499-8be4-fd5e4ab3ec17" status: 200 len: 1566 microversion: 2.1 time: 0.168128 Nov 22 12:25:04.758674 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 478/1022] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:25:04 2021] GET /compute/v2.1/servers/10e112a7-d70a-4499-8be4-fd5e4ab3ec17 => generated 1566 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:25:05.369514 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-fa1a15b2-c380-471d-9353-c5571aafcb98 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:25:05.370739 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-fa1a15b2-c380-471d-9353-c5571aafcb98 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: 496ce05f-ecc0-4dfd-b1d4-1c961f763af7] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:25:05.378178 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-fa1a15b2-c380-471d-9353-c5571aafcb98 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:05.378800 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-fa1a15b2-c380-471d-9353-c5571aafcb98 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:05.380197 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-fa1a15b2-c380-471d-9353-c5571aafcb98 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:05.380854 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-fa1a15b2-c380-471d-9353-c5571aafcb98 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:05.471495 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-fa1a15b2-c380-471d-9353-c5571aafcb98 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "POST /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7/action" status: 200 len: 32677 microversion: 2.20 time: 0.109025 Nov 22 12:25:05.472196 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 545/1023] 10.222.0.66 () {62 vars in 1318 bytes} [Mon Nov 22 12:25:05 2021] POST /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7/action => generated 32677 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 12:25:05.781674 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-3993f731-c094-46c4-8d7c-3cf71491beb3 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:25:05.782313 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-3993f731-c094-46c4-8d7c-3cf71491beb3 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] [instance: 10e112a7-d70a-4499-8be4-fd5e4ab3ec17] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:25:05.789158 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-3993f731-c094-46c4-8d7c-3cf71491beb3 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:05.789603 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-3993f731-c094-46c4-8d7c-3cf71491beb3 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:05.790391 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-3993f731-c094-46c4-8d7c-3cf71491beb3 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:05.790812 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-3993f731-c094-46c4-8d7c-3cf71491beb3 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:05.934690 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-3993f731-c094-46c4-8d7c-3cf71491beb3 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c15e2c2fa94be8b638f2257efb5820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575f4ae5262e4930b6658095a1aa8a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:25:05.942820 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-3993f731-c094-46c4-8d7c-3cf71491beb3 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] 10.222.0.66 "GET /compute/v2.1/servers/10e112a7-d70a-4499-8be4-fd5e4ab3ec17" status: 200 len: 1566 microversion: 2.1 time: 0.165431 Nov 22 12:25:05.943411 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 479/1024] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:25:05 2021] GET /compute/v2.1/servers/10e112a7-d70a-4499-8be4-fd5e4ab3ec17 => generated 1566 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:25:06.484345 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-9624771a-70d4-4807-a7bb-386bbf3d6b50 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:25:06.485355 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-9624771a-70d4-4807-a7bb-386bbf3d6b50 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: 496ce05f-ecc0-4dfd-b1d4-1c961f763af7] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:25:06.492525 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-9624771a-70d4-4807-a7bb-386bbf3d6b50 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:06.492969 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-9624771a-70d4-4807-a7bb-386bbf3d6b50 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:06.493758 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-9624771a-70d4-4807-a7bb-386bbf3d6b50 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:06.494160 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-9624771a-70d4-4807-a7bb-386bbf3d6b50 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:06.580085 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-9624771a-70d4-4807-a7bb-386bbf3d6b50 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "POST /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7/action" status: 200 len: 33432 microversion: 2.20 time: 0.099774 Nov 22 12:25:06.580722 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 546/1025] 10.222.0.66 () {62 vars in 1318 bytes} [Mon Nov 22 12:25:06 2021] POST /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7/action => generated 33432 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 12:25:06.960988 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-953dcf5f-aea9-4c59-aedc-050135dbf898 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:25:06.961680 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-953dcf5f-aea9-4c59-aedc-050135dbf898 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] [instance: 10e112a7-d70a-4499-8be4-fd5e4ab3ec17] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:25:06.968873 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-953dcf5f-aea9-4c59-aedc-050135dbf898 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:06.969338 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-953dcf5f-aea9-4c59-aedc-050135dbf898 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:06.970109 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-953dcf5f-aea9-4c59-aedc-050135dbf898 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:06.970536 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-953dcf5f-aea9-4c59-aedc-050135dbf898 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:07.111392 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-953dcf5f-aea9-4c59-aedc-050135dbf898 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c15e2c2fa94be8b638f2257efb5820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575f4ae5262e4930b6658095a1aa8a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:25:07.118865 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-953dcf5f-aea9-4c59-aedc-050135dbf898 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] 10.222.0.66 "GET /compute/v2.1/servers/10e112a7-d70a-4499-8be4-fd5e4ab3ec17" status: 200 len: 1566 microversion: 2.1 time: 0.161693 Nov 22 12:25:07.119460 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 480/1026] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:25:06 2021] GET /compute/v2.1/servers/10e112a7-d70a-4499-8be4-fd5e4ab3ec17 => generated 1566 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:25:07.593073 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-6390a81f-6f96-4bbd-a029-0a5e3e0d4340 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:25:07.594066 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-6390a81f-6f96-4bbd-a029-0a5e3e0d4340 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: 496ce05f-ecc0-4dfd-b1d4-1c961f763af7] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:25:07.601624 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-6390a81f-6f96-4bbd-a029-0a5e3e0d4340 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:07.602068 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-6390a81f-6f96-4bbd-a029-0a5e3e0d4340 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:07.602881 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-6390a81f-6f96-4bbd-a029-0a5e3e0d4340 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:07.603340 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-6390a81f-6f96-4bbd-a029-0a5e3e0d4340 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:07.684324 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-6390a81f-6f96-4bbd-a029-0a5e3e0d4340 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "POST /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7/action" status: 200 len: 34071 microversion: 2.20 time: 0.094982 Nov 22 12:25:07.685208 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 547/1027] 10.222.0.66 () {62 vars in 1318 bytes} [Mon Nov 22 12:25:07 2021] POST /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7/action => generated 34071 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 12:25:08.138918 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-ecfda863-a9aa-4552-9d11-eca0ac972c21 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:25:08.139653 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-ecfda863-a9aa-4552-9d11-eca0ac972c21 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] [instance: 10e112a7-d70a-4499-8be4-fd5e4ab3ec17] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:25:08.146511 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-ecfda863-a9aa-4552-9d11-eca0ac972c21 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:08.146967 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-ecfda863-a9aa-4552-9d11-eca0ac972c21 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:08.147787 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-ecfda863-a9aa-4552-9d11-eca0ac972c21 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:08.148225 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-ecfda863-a9aa-4552-9d11-eca0ac972c21 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:08.284993 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-ecfda863-a9aa-4552-9d11-eca0ac972c21 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c15e2c2fa94be8b638f2257efb5820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575f4ae5262e4930b6658095a1aa8a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:25:08.293251 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-ecfda863-a9aa-4552-9d11-eca0ac972c21 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] 10.222.0.66 "GET /compute/v2.1/servers/10e112a7-d70a-4499-8be4-fd5e4ab3ec17" status: 200 len: 1566 microversion: 2.1 time: 0.159714 Nov 22 12:25:08.293904 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 481/1028] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:25:08 2021] GET /compute/v2.1/servers/10e112a7-d70a-4499-8be4-fd5e4ab3ec17 => generated 1566 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:25:08.698871 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-f5f8588f-0f42-405d-9d0b-92a6d6a0ec4b tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:25:08.700189 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-f5f8588f-0f42-405d-9d0b-92a6d6a0ec4b tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: 496ce05f-ecc0-4dfd-b1d4-1c961f763af7] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:25:08.707964 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-f5f8588f-0f42-405d-9d0b-92a6d6a0ec4b tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:08.708420 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-f5f8588f-0f42-405d-9d0b-92a6d6a0ec4b tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:08.709214 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-f5f8588f-0f42-405d-9d0b-92a6d6a0ec4b tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:08.709648 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-f5f8588f-0f42-405d-9d0b-92a6d6a0ec4b tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:08.797506 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-f5f8588f-0f42-405d-9d0b-92a6d6a0ec4b tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "POST /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7/action" status: 200 len: 34950 microversion: 2.20 time: 0.103246 Nov 22 12:25:08.798074 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 548/1029] 10.222.0.66 () {62 vars in 1318 bytes} [Mon Nov 22 12:25:08 2021] POST /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7/action => generated 34950 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 12:25:09.312667 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-a293280d-5456-46cb-9fae-e540334c1d0c tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:25:09.313234 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-a293280d-5456-46cb-9fae-e540334c1d0c tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] [instance: 10e112a7-d70a-4499-8be4-fd5e4ab3ec17] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:25:09.319833 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-a293280d-5456-46cb-9fae-e540334c1d0c tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:09.320280 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-a293280d-5456-46cb-9fae-e540334c1d0c tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:09.321049 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-a293280d-5456-46cb-9fae-e540334c1d0c tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:09.321480 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-a293280d-5456-46cb-9fae-e540334c1d0c tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:09.472828 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-a293280d-5456-46cb-9fae-e540334c1d0c tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c15e2c2fa94be8b638f2257efb5820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575f4ae5262e4930b6658095a1aa8a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:25:09.484309 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-a293280d-5456-46cb-9fae-e540334c1d0c tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] 10.222.0.66 "GET /compute/v2.1/servers/10e112a7-d70a-4499-8be4-fd5e4ab3ec17" status: 200 len: 1566 microversion: 2.1 time: 0.176084 Nov 22 12:25:09.484906 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 482/1030] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:25:09 2021] GET /compute/v2.1/servers/10e112a7-d70a-4499-8be4-fd5e4ab3ec17 => generated 1566 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:25:09.810378 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-96f58e12-76f1-4e22-842c-4a788e3477f5 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:25:09.811435 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-96f58e12-76f1-4e22-842c-4a788e3477f5 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: 496ce05f-ecc0-4dfd-b1d4-1c961f763af7] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:25:09.820085 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-96f58e12-76f1-4e22-842c-4a788e3477f5 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:09.820714 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-96f58e12-76f1-4e22-842c-4a788e3477f5 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:09.821858 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-96f58e12-76f1-4e22-842c-4a788e3477f5 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:09.822354 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-96f58e12-76f1-4e22-842c-4a788e3477f5 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:10.060789 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-96f58e12-76f1-4e22-842c-4a788e3477f5 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "POST /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7/action" status: 200 len: 36012 microversion: 2.20 time: 0.254324 Nov 22 12:25:10.061335 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 549/1031] 10.222.0.66 () {62 vars in 1318 bytes} [Mon Nov 22 12:25:09 2021] POST /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7/action => generated 36012 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 12:25:10.502369 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-dd9f9636-34ac-4ba2-8150-841593b2466d tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:25:10.502974 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-dd9f9636-34ac-4ba2-8150-841593b2466d tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] [instance: 10e112a7-d70a-4499-8be4-fd5e4ab3ec17] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:25:10.509687 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-dd9f9636-34ac-4ba2-8150-841593b2466d tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:10.510135 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-dd9f9636-34ac-4ba2-8150-841593b2466d tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:10.510924 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-dd9f9636-34ac-4ba2-8150-841593b2466d tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:10.511387 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-dd9f9636-34ac-4ba2-8150-841593b2466d tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:10.660992 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-dd9f9636-34ac-4ba2-8150-841593b2466d tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c15e2c2fa94be8b638f2257efb5820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575f4ae5262e4930b6658095a1aa8a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:25:10.668954 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-dd9f9636-34ac-4ba2-8150-841593b2466d tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] 10.222.0.66 "GET /compute/v2.1/servers/10e112a7-d70a-4499-8be4-fd5e4ab3ec17" status: 200 len: 1566 microversion: 2.1 time: 0.170408 Nov 22 12:25:10.669517 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 483/1032] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:25:10 2021] GET /compute/v2.1/servers/10e112a7-d70a-4499-8be4-fd5e4ab3ec17 => generated 1566 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:25:11.076411 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-95ca4319-f301-4927-b175-9df0d323aaf3 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:25:11.077452 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-95ca4319-f301-4927-b175-9df0d323aaf3 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: 496ce05f-ecc0-4dfd-b1d4-1c961f763af7] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:25:11.084759 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-95ca4319-f301-4927-b175-9df0d323aaf3 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:11.085216 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-95ca4319-f301-4927-b175-9df0d323aaf3 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:11.086014 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-95ca4319-f301-4927-b175-9df0d323aaf3 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:11.086465 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-95ca4319-f301-4927-b175-9df0d323aaf3 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:11.170261 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-95ca4319-f301-4927-b175-9df0d323aaf3 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "POST /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7/action" status: 200 len: 37436 microversion: 2.20 time: 0.099806 Nov 22 12:25:11.170899 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 550/1033] 10.222.0.66 () {62 vars in 1318 bytes} [Mon Nov 22 12:25:11 2021] POST /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7/action => generated 37436 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 12:25:11.688282 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-ab83feb0-3c0c-4822-ad90-ee6be8568c65 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:25:11.688893 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-ab83feb0-3c0c-4822-ad90-ee6be8568c65 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] [instance: 10e112a7-d70a-4499-8be4-fd5e4ab3ec17] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:25:11.698403 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-ab83feb0-3c0c-4822-ad90-ee6be8568c65 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:11.699014 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-ab83feb0-3c0c-4822-ad90-ee6be8568c65 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:11.700187 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-ab83feb0-3c0c-4822-ad90-ee6be8568c65 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:11.700691 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-ab83feb0-3c0c-4822-ad90-ee6be8568c65 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:11.849420 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-ab83feb0-3c0c-4822-ad90-ee6be8568c65 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c15e2c2fa94be8b638f2257efb5820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575f4ae5262e4930b6658095a1aa8a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:25:11.860214 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-ab83feb0-3c0c-4822-ad90-ee6be8568c65 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] 10.222.0.66 "GET /compute/v2.1/servers/10e112a7-d70a-4499-8be4-fd5e4ab3ec17" status: 200 len: 1566 microversion: 2.1 time: 0.177136 Nov 22 12:25:11.860830 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 484/1034] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:25:11 2021] GET /compute/v2.1/servers/10e112a7-d70a-4499-8be4-fd5e4ab3ec17 => generated 1566 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:25:12.183437 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-f87c42b0-3de5-4282-8293-497f14fb225b tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:25:12.184336 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-f87c42b0-3de5-4282-8293-497f14fb225b tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: 496ce05f-ecc0-4dfd-b1d4-1c961f763af7] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:25:12.191914 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-f87c42b0-3de5-4282-8293-497f14fb225b tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:12.192364 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-f87c42b0-3de5-4282-8293-497f14fb225b tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:12.193829 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-f87c42b0-3de5-4282-8293-497f14fb225b tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:12.194276 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-f87c42b0-3de5-4282-8293-497f14fb225b tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:12.272640 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-f87c42b0-3de5-4282-8293-497f14fb225b tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "POST /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7/action" status: 200 len: 38208 microversion: 2.20 time: 0.093218 Nov 22 12:25:12.273297 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 551/1035] 10.222.0.66 () {62 vars in 1318 bytes} [Mon Nov 22 12:25:12 2021] POST /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7/action => generated 38208 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 12:25:12.878833 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-9a6c79f4-a199-460d-b587-f37d82fd53e0 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:25:12.879468 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-9a6c79f4-a199-460d-b587-f37d82fd53e0 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] [instance: 10e112a7-d70a-4499-8be4-fd5e4ab3ec17] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:25:12.889697 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-9a6c79f4-a199-460d-b587-f37d82fd53e0 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:12.890150 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-9a6c79f4-a199-460d-b587-f37d82fd53e0 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:12.890954 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-9a6c79f4-a199-460d-b587-f37d82fd53e0 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:12.891425 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-9a6c79f4-a199-460d-b587-f37d82fd53e0 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:13.039805 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-9a6c79f4-a199-460d-b587-f37d82fd53e0 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c15e2c2fa94be8b638f2257efb5820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575f4ae5262e4930b6658095a1aa8a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:25:13.047368 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-9a6c79f4-a199-460d-b587-f37d82fd53e0 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] 10.222.0.66 "GET /compute/v2.1/servers/10e112a7-d70a-4499-8be4-fd5e4ab3ec17" status: 200 len: 1566 microversion: 2.1 time: 0.172612 Nov 22 12:25:13.047931 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 485/1036] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:25:12 2021] GET /compute/v2.1/servers/10e112a7-d70a-4499-8be4-fd5e4ab3ec17 => generated 1566 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:25:13.285872 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-058d64bb-6e51-458b-820a-973096e4c250 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:25:13.286898 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-058d64bb-6e51-458b-820a-973096e4c250 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: 496ce05f-ecc0-4dfd-b1d4-1c961f763af7] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:25:13.294334 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-058d64bb-6e51-458b-820a-973096e4c250 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:13.294965 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-058d64bb-6e51-458b-820a-973096e4c250 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:13.296183 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-058d64bb-6e51-458b-820a-973096e4c250 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:13.296614 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-058d64bb-6e51-458b-820a-973096e4c250 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:13.365529 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-058d64bb-6e51-458b-820a-973096e4c250 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "POST /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7/action" status: 200 len: 38208 microversion: 2.20 time: 0.083800 Nov 22 12:25:13.366175 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 552/1037] 10.222.0.66 () {62 vars in 1318 bytes} [Mon Nov 22 12:25:13 2021] POST /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7/action => generated 38208 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 22 12:25:14.065583 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-a415a2f2-1d51-4d17-87d8-54fb1da5ea9c tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:25:14.066141 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-a415a2f2-1d51-4d17-87d8-54fb1da5ea9c tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] [instance: 10e112a7-d70a-4499-8be4-fd5e4ab3ec17] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:25:14.073000 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-a415a2f2-1d51-4d17-87d8-54fb1da5ea9c tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:14.073513 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-a415a2f2-1d51-4d17-87d8-54fb1da5ea9c tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:14.074245 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-a415a2f2-1d51-4d17-87d8-54fb1da5ea9c tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:14.074674 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-a415a2f2-1d51-4d17-87d8-54fb1da5ea9c tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:14.226557 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-a415a2f2-1d51-4d17-87d8-54fb1da5ea9c tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c15e2c2fa94be8b638f2257efb5820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575f4ae5262e4930b6658095a1aa8a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:25:14.235189 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-a415a2f2-1d51-4d17-87d8-54fb1da5ea9c tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] 10.222.0.66 "GET /compute/v2.1/servers/10e112a7-d70a-4499-8be4-fd5e4ab3ec17" status: 200 len: 1566 microversion: 2.1 time: 0.173229 Nov 22 12:25:14.235949 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 486/1038] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:25:14 2021] GET /compute/v2.1/servers/10e112a7-d70a-4499-8be4-fd5e4ab3ec17 => generated 1566 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:25:14.378753 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-02e804f1-b905-4918-86f6-5b17b62c1106 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:25:14.379705 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-02e804f1-b905-4918-86f6-5b17b62c1106 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: 496ce05f-ecc0-4dfd-b1d4-1c961f763af7] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:25:14.386713 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-02e804f1-b905-4918-86f6-5b17b62c1106 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:14.387158 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-02e804f1-b905-4918-86f6-5b17b62c1106 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:14.387973 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-02e804f1-b905-4918-86f6-5b17b62c1106 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:14.388407 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-02e804f1-b905-4918-86f6-5b17b62c1106 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:14.458231 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-02e804f1-b905-4918-86f6-5b17b62c1106 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "POST /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7/action" status: 200 len: 38208 microversion: 2.20 time: 0.084181 Nov 22 12:25:14.458802 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 553/1039] 10.222.0.66 () {62 vars in 1318 bytes} [Mon Nov 22 12:25:14 2021] POST /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7/action => generated 38208 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 12:25:15.253848 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-6d5de30a-6634-48ec-8a15-9056d603faa7 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:25:15.254492 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-6d5de30a-6634-48ec-8a15-9056d603faa7 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] [instance: 10e112a7-d70a-4499-8be4-fd5e4ab3ec17] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:25:15.261291 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-6d5de30a-6634-48ec-8a15-9056d603faa7 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:15.261802 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-6d5de30a-6634-48ec-8a15-9056d603faa7 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:15.262573 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-6d5de30a-6634-48ec-8a15-9056d603faa7 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:15.263001 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-6d5de30a-6634-48ec-8a15-9056d603faa7 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:15.470856 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-e51bebaa-2983-4dec-93d9-786881593aa1 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:25:15.471970 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-e51bebaa-2983-4dec-93d9-786881593aa1 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: 496ce05f-ecc0-4dfd-b1d4-1c961f763af7] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:25:15.479566 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-e51bebaa-2983-4dec-93d9-786881593aa1 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:15.480019 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-e51bebaa-2983-4dec-93d9-786881593aa1 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:15.480821 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-e51bebaa-2983-4dec-93d9-786881593aa1 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:15.481257 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-e51bebaa-2983-4dec-93d9-786881593aa1 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:15.516859 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-6d5de30a-6634-48ec-8a15-9056d603faa7 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c15e2c2fa94be8b638f2257efb5820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575f4ae5262e4930b6658095a1aa8a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:25:15.524439 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-6d5de30a-6634-48ec-8a15-9056d603faa7 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] 10.222.0.66 "GET /compute/v2.1/servers/10e112a7-d70a-4499-8be4-fd5e4ab3ec17" status: 200 len: 1566 microversion: 2.1 time: 0.274903 Nov 22 12:25:15.525101 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 487/1040] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:25:15 2021] GET /compute/v2.1/servers/10e112a7-d70a-4499-8be4-fd5e4ab3ec17 => generated 1566 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:25:15.572949 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-e51bebaa-2983-4dec-93d9-786881593aa1 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "POST /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7/action" status: 200 len: 38349 microversion: 2.20 time: 0.106043 Nov 22 12:25:15.573628 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 554/1041] 10.222.0.66 () {62 vars in 1318 bytes} [Mon Nov 22 12:25:15 2021] POST /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7/action => generated 38349 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 22 12:25:15.584321 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-040981d9-9cf0-4147-91ac-75e3035d9cb4 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:25:15.584806 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-040981d9-9cf0-4147-91ac-75e3035d9cb4 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: 496ce05f-ecc0-4dfd-b1d4-1c961f763af7] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:25:15.592503 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-040981d9-9cf0-4147-91ac-75e3035d9cb4 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:15.592943 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-040981d9-9cf0-4147-91ac-75e3035d9cb4 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:15.593747 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-040981d9-9cf0-4147-91ac-75e3035d9cb4 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:15.594213 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-040981d9-9cf0-4147-91ac-75e3035d9cb4 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:15.618705 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-040981d9-9cf0-4147-91ac-75e3035d9cb4 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "GET /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7/ips" status: 200 len: 150 microversion: 2.20 time: 0.038188 Nov 22 12:25:15.619287 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 488/1042] 10.222.0.66 () {60 vars in 1288 bytes} [Mon Nov 22 12:25:15 2021] GET /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7/ips => generated 150 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 22 12:25:16.542885 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-995db893-ddda-441b-9e55-c8c269bd7c26 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:25:16.543583 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-995db893-ddda-441b-9e55-c8c269bd7c26 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] [instance: 10e112a7-d70a-4499-8be4-fd5e4ab3ec17] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:25:16.551502 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-995db893-ddda-441b-9e55-c8c269bd7c26 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:16.551941 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-995db893-ddda-441b-9e55-c8c269bd7c26 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:16.552735 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-995db893-ddda-441b-9e55-c8c269bd7c26 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:16.553168 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-995db893-ddda-441b-9e55-c8c269bd7c26 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:16.707087 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-995db893-ddda-441b-9e55-c8c269bd7c26 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c15e2c2fa94be8b638f2257efb5820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575f4ae5262e4930b6658095a1aa8a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:25:16.717848 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-995db893-ddda-441b-9e55-c8c269bd7c26 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] 10.222.0.66 "GET /compute/v2.1/servers/10e112a7-d70a-4499-8be4-fd5e4ab3ec17" status: 200 len: 1566 microversion: 2.1 time: 0.178914 Nov 22 12:25:16.718513 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 555/1043] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:25:16 2021] GET /compute/v2.1/servers/10e112a7-d70a-4499-8be4-fd5e4ab3ec17 => generated 1566 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:25:17.735560 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-ed4149bf-f1c5-4ec4-ac27-3b512a2ed99d tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:25:17.736178 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-ed4149bf-f1c5-4ec4-ac27-3b512a2ed99d tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] [instance: 10e112a7-d70a-4499-8be4-fd5e4ab3ec17] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:25:17.744417 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-ed4149bf-f1c5-4ec4-ac27-3b512a2ed99d tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:17.744917 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-ed4149bf-f1c5-4ec4-ac27-3b512a2ed99d tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:17.745824 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-ed4149bf-f1c5-4ec4-ac27-3b512a2ed99d tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:17.746267 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-ed4149bf-f1c5-4ec4-ac27-3b512a2ed99d tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:17.815734 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-22471934-1b88-419e-8a3f-7db34fad0a95 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:25:17.816547 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-22471934-1b88-419e-8a3f-7db34fad0a95 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: 496ce05f-ecc0-4dfd-b1d4-1c961f763af7] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:25:17.822882 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-22471934-1b88-419e-8a3f-7db34fad0a95 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:17.823433 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-22471934-1b88-419e-8a3f-7db34fad0a95 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:17.824310 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-22471934-1b88-419e-8a3f-7db34fad0a95 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:17.824836 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-22471934-1b88-419e-8a3f-7db34fad0a95 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:17.850949 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.objects.instance [None req-22471934-1b88-419e-8a3f-7db34fad0a95 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lazy-loading 'flavor' on Instance uuid 496ce05f-ecc0-4dfd-b1d4-1c961f763af7 {{(pid=116272) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 22 12:25:17.895769 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-ed4149bf-f1c5-4ec4-ac27-3b512a2ed99d tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c15e2c2fa94be8b638f2257efb5820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575f4ae5262e4930b6658095a1aa8a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:25:17.903615 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-ed4149bf-f1c5-4ec4-ac27-3b512a2ed99d tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] 10.222.0.66 "GET /compute/v2.1/servers/10e112a7-d70a-4499-8be4-fd5e4ab3ec17" status: 200 len: 1567 microversion: 2.1 time: 0.171756 Nov 22 12:25:17.904184 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 489/1044] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:25:17 2021] GET /compute/v2.1/servers/10e112a7-d70a-4499-8be4-fd5e4ab3ec17 => generated 1567 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:25:17.922118 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-12ba5248-8484-42cf-8781-0cb4507e7ad7 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:25:17.923172 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-12ba5248-8484-42cf-8781-0cb4507e7ad7 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] [instance: 10e112a7-d70a-4499-8be4-fd5e4ab3ec17] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:25:17.929221 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-12ba5248-8484-42cf-8781-0cb4507e7ad7 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:17.929757 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-12ba5248-8484-42cf-8781-0cb4507e7ad7 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:17.930762 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-12ba5248-8484-42cf-8781-0cb4507e7ad7 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:17.931304 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-12ba5248-8484-42cf-8781-0cb4507e7ad7 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:18.119639 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-22471934-1b88-419e-8a3f-7db34fad0a95 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "POST /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7/action" status: 202 len: 0 microversion: 2.20 time: 0.307505 Nov 22 12:25:18.123730 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 556/1045] 10.222.0.66 () {62 vars in 1318 bytes} [Mon Nov 22 12:25:17 2021] POST /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7/action => generated 0 bytes in 310 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 22 12:25:18.130125 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-12ba5248-8484-42cf-8781-0cb4507e7ad7 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] 10.222.0.66 "POST /compute/v2.1/servers/10e112a7-d70a-4499-8be4-fd5e4ab3ec17/action" status: 202 len: 0 microversion: 2.1 time: 0.211445 Nov 22 12:25:18.133618 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 490/1046] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Nov 22 12:25:17 2021] POST /compute/v2.1/servers/10e112a7-d70a-4499-8be4-fd5e4ab3ec17/action => generated 0 bytes in 213 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 22 12:25:18.134787 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-8bad8629-bbe9-410a-9f56-d1cd90972170 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:25:18.136339 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-8bad8629-bbe9-410a-9f56-d1cd90972170 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: 496ce05f-ecc0-4dfd-b1d4-1c961f763af7] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:25:18.138327 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-690c1b19-4f12-4ac5-b57a-a6f8074fb95f tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:25:18.139125 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-690c1b19-4f12-4ac5-b57a-a6f8074fb95f tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] [instance: 10e112a7-d70a-4499-8be4-fd5e4ab3ec17] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:25:18.146927 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-8bad8629-bbe9-410a-9f56-d1cd90972170 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:18.147490 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-8bad8629-bbe9-410a-9f56-d1cd90972170 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:18.148453 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-8bad8629-bbe9-410a-9f56-d1cd90972170 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:18.149601 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-8bad8629-bbe9-410a-9f56-d1cd90972170 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:18.149814 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-690c1b19-4f12-4ac5-b57a-a6f8074fb95f tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:18.151212 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-690c1b19-4f12-4ac5-b57a-a6f8074fb95f tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:18.151987 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-690c1b19-4f12-4ac5-b57a-a6f8074fb95f tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:18.152973 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-690c1b19-4f12-4ac5-b57a-a6f8074fb95f tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:18.369920 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-690c1b19-4f12-4ac5-b57a-a6f8074fb95f tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c15e2c2fa94be8b638f2257efb5820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575f4ae5262e4930b6658095a1aa8a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:25:18.373037 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-8bad8629-bbe9-410a-9f56-d1cd90972170 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:25:18.379741 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-690c1b19-4f12-4ac5-b57a-a6f8074fb95f tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] 10.222.0.66 "GET /compute/v2.1/servers/10e112a7-d70a-4499-8be4-fd5e4ab3ec17" status: 200 len: 1575 microversion: 2.1 time: 0.244740 Nov 22 12:25:18.380804 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 491/1047] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:25:18 2021] GET /compute/v2.1/servers/10e112a7-d70a-4499-8be4-fd5e4ab3ec17 => generated 1575 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 12:25:18.381588 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-8bad8629-bbe9-410a-9f56-d1cd90972170 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:25:18.383064 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-8bad8629-bbe9-410a-9f56-d1cd90972170 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:25:18.384260 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-8bad8629-bbe9-410a-9f56-d1cd90972170 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "GET /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7" status: 200 len: 1721 microversion: 2.20 time: 0.258109 Nov 22 12:25:18.384988 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 557/1048] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Nov 22 12:25:18 2021] GET /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7 => generated 1721 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 22 12:25:19.398092 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-4c9e88f7-0b0e-431b-9eac-6054c62deb66 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:25:19.398836 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-4c9e88f7-0b0e-431b-9eac-6054c62deb66 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] [instance: 10e112a7-d70a-4499-8be4-fd5e4ab3ec17] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:25:19.402840 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-9ae0a05c-ee05-4fd8-b2de-e7541b356df4 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:25:19.403388 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-9ae0a05c-ee05-4fd8-b2de-e7541b356df4 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: 496ce05f-ecc0-4dfd-b1d4-1c961f763af7] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:25:19.407048 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-4c9e88f7-0b0e-431b-9eac-6054c62deb66 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:19.408621 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-4c9e88f7-0b0e-431b-9eac-6054c62deb66 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:19.409657 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-4c9e88f7-0b0e-431b-9eac-6054c62deb66 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:19.410085 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-4c9e88f7-0b0e-431b-9eac-6054c62deb66 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:19.410268 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-9ae0a05c-ee05-4fd8-b2de-e7541b356df4 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:19.410719 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-9ae0a05c-ee05-4fd8-b2de-e7541b356df4 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:19.411581 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-9ae0a05c-ee05-4fd8-b2de-e7541b356df4 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:19.412107 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-9ae0a05c-ee05-4fd8-b2de-e7541b356df4 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:19.629907 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-4c9e88f7-0b0e-431b-9eac-6054c62deb66 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c15e2c2fa94be8b638f2257efb5820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575f4ae5262e4930b6658095a1aa8a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:25:19.638792 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-4c9e88f7-0b0e-431b-9eac-6054c62deb66 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] 10.222.0.66 "GET /compute/v2.1/servers/10e112a7-d70a-4499-8be4-fd5e4ab3ec17" status: 200 len: 1517 microversion: 2.1 time: 0.244660 Nov 22 12:25:19.639529 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 492/1049] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:25:19 2021] GET /compute/v2.1/servers/10e112a7-d70a-4499-8be4-fd5e4ab3ec17 => generated 1517 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:25:19.643717 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-9ae0a05c-ee05-4fd8-b2de-e7541b356df4 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:25:19.654452 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-9ae0a05c-ee05-4fd8-b2de-e7541b356df4 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:25:19.657005 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-9ae0a05c-ee05-4fd8-b2de-e7541b356df4 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:25:19.658975 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-9ae0a05c-ee05-4fd8-b2de-e7541b356df4 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "GET /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7" status: 200 len: 1721 microversion: 2.20 time: 0.260066 Nov 22 12:25:19.659690 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 558/1050] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Nov 22 12:25:19 2021] GET /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7 => generated 1721 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 12:25:20.660416 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-6b428168-98a5-40f8-a881-81d1ff37ddef tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:25:20.661043 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-6b428168-98a5-40f8-a881-81d1ff37ddef tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] [instance: 10e112a7-d70a-4499-8be4-fd5e4ab3ec17] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:25:20.668040 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-6b428168-98a5-40f8-a881-81d1ff37ddef tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:20.668488 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-6b428168-98a5-40f8-a881-81d1ff37ddef tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:20.669266 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-6b428168-98a5-40f8-a881-81d1ff37ddef tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:20.669692 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-6b428168-98a5-40f8-a881-81d1ff37ddef tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:20.681937 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-01b09df3-123e-4df4-b750-fd00b923f2aa tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:25:20.682565 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-01b09df3-123e-4df4-b750-fd00b923f2aa tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: 496ce05f-ecc0-4dfd-b1d4-1c961f763af7] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:25:20.689588 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-01b09df3-123e-4df4-b750-fd00b923f2aa tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:20.690012 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-01b09df3-123e-4df4-b750-fd00b923f2aa tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:20.690841 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-01b09df3-123e-4df4-b750-fd00b923f2aa tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:20.691271 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-01b09df3-123e-4df4-b750-fd00b923f2aa tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:20.884378 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-6b428168-98a5-40f8-a881-81d1ff37ddef tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c15e2c2fa94be8b638f2257efb5820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575f4ae5262e4930b6658095a1aa8a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:25:20.886007 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-01b09df3-123e-4df4-b750-fd00b923f2aa tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:25:20.894026 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-6b428168-98a5-40f8-a881-81d1ff37ddef tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] 10.222.0.66 "GET /compute/v2.1/servers/10e112a7-d70a-4499-8be4-fd5e4ab3ec17" status: 200 len: 1573 microversion: 2.1 time: 0.237173 Nov 22 12:25:20.894647 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 493/1051] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:25:20 2021] GET /compute/v2.1/servers/10e112a7-d70a-4499-8be4-fd5e4ab3ec17 => generated 1573 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:25:20.895866 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-01b09df3-123e-4df4-b750-fd00b923f2aa tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:25:20.897369 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-01b09df3-123e-4df4-b750-fd00b923f2aa tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:25:20.898612 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-01b09df3-123e-4df4-b750-fd00b923f2aa tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "GET /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7" status: 200 len: 1721 microversion: 2.20 time: 0.220666 Nov 22 12:25:20.899192 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 559/1052] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Nov 22 12:25:20 2021] GET /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7 => generated 1721 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 12:25:21.374867 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [req-4d524a2b-ee2b-4288-ae39-98db3a1da84c req-6e6026c1-b90c-424a-a44d-7496f59ecc04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10e112a7-d70a-4499-8be4-fd5e4ab3ec17", "name": "network-vif-unplugged", "status": "completed", "tag": "c27e22cf-346f-4a81-8e7d-d2418b4df811"}]} {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:25:21.376518 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 12:25:21.376518 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: warnings.warn(msg) Nov 22 12:25:21.384443 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [req-4d524a2b-ee2b-4288-ae39-98db3a1da84c req-6e6026c1-b90c-424a-a44d-7496f59ecc04 service nova] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:21.384878 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [req-4d524a2b-ee2b-4288-ae39-98db3a1da84c req-6e6026c1-b90c-424a-a44d-7496f59ecc04 service nova] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:21.396188 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.compute.server_external_events [req-4d524a2b-ee2b-4288-ae39-98db3a1da84c req-6e6026c1-b90c-424a-a44d-7496f59ecc04 service nova] Creating event network-vif-unplugged:c27e22cf-346f-4a81-8e7d-d2418b4df811 for instance 10e112a7-d70a-4499-8be4-fd5e4ab3ec17 on hv-cinder-76845 Nov 22 12:25:21.402919 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [req-4d524a2b-ee2b-4288-ae39-98db3a1da84c req-6e6026c1-b90c-424a-a44d-7496f59ecc04 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.163980 Nov 22 12:25:21.403603 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 494/1053] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Nov 22 12:25:21 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 12:25:21.920071 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-5b17473e-7d3c-4dfe-9901-67615e83bd1f tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:25:21.920671 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-5b17473e-7d3c-4dfe-9901-67615e83bd1f tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] [instance: 10e112a7-d70a-4499-8be4-fd5e4ab3ec17] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:25:21.922885 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-633b5111-7a7b-440a-8e90-1e9b56a6ba73 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:25:21.923633 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-633b5111-7a7b-440a-8e90-1e9b56a6ba73 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: 496ce05f-ecc0-4dfd-b1d4-1c961f763af7] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:25:21.927352 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-5b17473e-7d3c-4dfe-9901-67615e83bd1f tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:21.927808 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-5b17473e-7d3c-4dfe-9901-67615e83bd1f tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:21.928576 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-5b17473e-7d3c-4dfe-9901-67615e83bd1f tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:21.929128 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-5b17473e-7d3c-4dfe-9901-67615e83bd1f tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:21.929843 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-633b5111-7a7b-440a-8e90-1e9b56a6ba73 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:21.930292 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-633b5111-7a7b-440a-8e90-1e9b56a6ba73 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:21.931074 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-633b5111-7a7b-440a-8e90-1e9b56a6ba73 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:21.931539 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-633b5111-7a7b-440a-8e90-1e9b56a6ba73 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:22.145455 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-5b17473e-7d3c-4dfe-9901-67615e83bd1f tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c15e2c2fa94be8b638f2257efb5820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575f4ae5262e4930b6658095a1aa8a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:25:22.150606 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-633b5111-7a7b-440a-8e90-1e9b56a6ba73 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:25:22.160130 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-5b17473e-7d3c-4dfe-9901-67615e83bd1f tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] 10.222.0.66 "GET /compute/v2.1/servers/10e112a7-d70a-4499-8be4-fd5e4ab3ec17" status: 200 len: 1573 microversion: 2.1 time: 0.244262 Nov 22 12:25:22.161325 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 560/1054] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:25:21 2021] GET /compute/v2.1/servers/10e112a7-d70a-4499-8be4-fd5e4ab3ec17 => generated 1573 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 12:25:22.163431 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-633b5111-7a7b-440a-8e90-1e9b56a6ba73 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:25:22.165181 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-633b5111-7a7b-440a-8e90-1e9b56a6ba73 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:25:22.166507 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-633b5111-7a7b-440a-8e90-1e9b56a6ba73 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "GET /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7" status: 200 len: 1721 microversion: 2.20 time: 0.248306 Nov 22 12:25:22.167082 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 495/1055] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Nov 22 12:25:21 2021] GET /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7 => generated 1721 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 12:25:23.185506 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-8070772e-b842-4ccd-bd78-a72bfd78895f tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:25:23.186114 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-8070772e-b842-4ccd-bd78-a72bfd78895f tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] [instance: 10e112a7-d70a-4499-8be4-fd5e4ab3ec17] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:25:23.186510 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-255daaaf-45d6-4346-80f6-57547a4bf750 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:25:23.187110 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-255daaaf-45d6-4346-80f6-57547a4bf750 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: 496ce05f-ecc0-4dfd-b1d4-1c961f763af7] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:25:23.193059 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-8070772e-b842-4ccd-bd78-a72bfd78895f tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:23.193508 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-8070772e-b842-4ccd-bd78-a72bfd78895f tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:23.194298 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-8070772e-b842-4ccd-bd78-a72bfd78895f tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:23.194439 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-255daaaf-45d6-4346-80f6-57547a4bf750 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:23.194730 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-8070772e-b842-4ccd-bd78-a72bfd78895f tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:23.194886 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-255daaaf-45d6-4346-80f6-57547a4bf750 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:23.195615 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-255daaaf-45d6-4346-80f6-57547a4bf750 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:23.196035 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-255daaaf-45d6-4346-80f6-57547a4bf750 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:23.394353 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-255daaaf-45d6-4346-80f6-57547a4bf750 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:25:23.398598 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-8070772e-b842-4ccd-bd78-a72bfd78895f tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c15e2c2fa94be8b638f2257efb5820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575f4ae5262e4930b6658095a1aa8a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:25:23.403061 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-255daaaf-45d6-4346-80f6-57547a4bf750 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:25:23.404549 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-255daaaf-45d6-4346-80f6-57547a4bf750 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:25:23.405731 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-255daaaf-45d6-4346-80f6-57547a4bf750 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "GET /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7" status: 200 len: 1721 microversion: 2.20 time: 0.222922 Nov 22 12:25:23.407059 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 496/1056] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Nov 22 12:25:23 2021] GET /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7 => generated 1721 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 12:25:23.412742 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-8070772e-b842-4ccd-bd78-a72bfd78895f tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] 10.222.0.66 "GET /compute/v2.1/servers/10e112a7-d70a-4499-8be4-fd5e4ab3ec17" status: 200 len: 1573 microversion: 2.1 time: 0.224812 Nov 22 12:25:23.412742 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 561/1057] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:25:23 2021] GET /compute/v2.1/servers/10e112a7-d70a-4499-8be4-fd5e4ab3ec17 => generated 1573 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:25:24.423692 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-679292fc-3d50-4e35-bdc4-99a6bf793c87 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:25:24.424309 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-679292fc-3d50-4e35-bdc4-99a6bf793c87 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] [instance: 10e112a7-d70a-4499-8be4-fd5e4ab3ec17] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:25:24.424477 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-9b2b6fd1-63fe-4131-aa6f-4d67d0c54424 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:25:24.425110 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-9b2b6fd1-63fe-4131-aa6f-4d67d0c54424 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: 496ce05f-ecc0-4dfd-b1d4-1c961f763af7] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:25:24.431204 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-679292fc-3d50-4e35-bdc4-99a6bf793c87 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:24.431687 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-679292fc-3d50-4e35-bdc4-99a6bf793c87 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:24.431854 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-9b2b6fd1-63fe-4131-aa6f-4d67d0c54424 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:24.432183 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-9b2b6fd1-63fe-4131-aa6f-4d67d0c54424 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:24.432488 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-679292fc-3d50-4e35-bdc4-99a6bf793c87 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:24.433459 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-679292fc-3d50-4e35-bdc4-99a6bf793c87 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:24.433607 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-9b2b6fd1-63fe-4131-aa6f-4d67d0c54424 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:24.433607 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-9b2b6fd1-63fe-4131-aa6f-4d67d0c54424 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:24.646829 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-9b2b6fd1-63fe-4131-aa6f-4d67d0c54424 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:25:24.651501 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-679292fc-3d50-4e35-bdc4-99a6bf793c87 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c15e2c2fa94be8b638f2257efb5820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575f4ae5262e4930b6658095a1aa8a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:25:24.659128 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-9b2b6fd1-63fe-4131-aa6f-4d67d0c54424 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:25:24.661572 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-9b2b6fd1-63fe-4131-aa6f-4d67d0c54424 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:25:24.663318 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-9b2b6fd1-63fe-4131-aa6f-4d67d0c54424 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "GET /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7" status: 200 len: 1721 microversion: 2.20 time: 0.242649 Nov 22 12:25:24.664207 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 562/1058] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Nov 22 12:25:24 2021] GET /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7 => generated 1721 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 12:25:24.666638 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-679292fc-3d50-4e35-bdc4-99a6bf793c87 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] 10.222.0.66 "GET /compute/v2.1/servers/10e112a7-d70a-4499-8be4-fd5e4ab3ec17" status: 200 len: 1573 microversion: 2.1 time: 0.246474 Nov 22 12:25:24.667886 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 497/1059] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:25:24 2021] GET /compute/v2.1/servers/10e112a7-d70a-4499-8be4-fd5e4ab3ec17 => generated 1573 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:25:25.682322 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-49545001-eb41-49d2-a799-1970c658c21d tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:25:25.682921 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-49545001-eb41-49d2-a799-1970c658c21d tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: 496ce05f-ecc0-4dfd-b1d4-1c961f763af7] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:25:25.684629 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-2e51ceb5-68b1-4405-96aa-ee6e9faaf01d tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:25:25.685274 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-2e51ceb5-68b1-4405-96aa-ee6e9faaf01d tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] [instance: 10e112a7-d70a-4499-8be4-fd5e4ab3ec17] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:25:25.690228 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-49545001-eb41-49d2-a799-1970c658c21d tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:25.690677 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-49545001-eb41-49d2-a799-1970c658c21d tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:25.691512 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-49545001-eb41-49d2-a799-1970c658c21d tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:25.691940 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-49545001-eb41-49d2-a799-1970c658c21d tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:25.692101 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-2e51ceb5-68b1-4405-96aa-ee6e9faaf01d tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:25.692553 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-2e51ceb5-68b1-4405-96aa-ee6e9faaf01d tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:25.693401 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-2e51ceb5-68b1-4405-96aa-ee6e9faaf01d tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:25.693777 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-2e51ceb5-68b1-4405-96aa-ee6e9faaf01d tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:25.907024 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-49545001-eb41-49d2-a799-1970c658c21d tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:25:25.916096 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-49545001-eb41-49d2-a799-1970c658c21d tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:25:25.916768 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-2e51ceb5-68b1-4405-96aa-ee6e9faaf01d tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c15e2c2fa94be8b638f2257efb5820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575f4ae5262e4930b6658095a1aa8a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:25:25.917689 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-49545001-eb41-49d2-a799-1970c658c21d tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:25:25.918798 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-49545001-eb41-49d2-a799-1970c658c21d tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "GET /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7" status: 200 len: 1721 microversion: 2.20 time: 0.240384 Nov 22 12:25:25.919379 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 563/1060] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Nov 22 12:25:25 2021] GET /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7 => generated 1721 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 12:25:25.925202 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-2e51ceb5-68b1-4405-96aa-ee6e9faaf01d tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] 10.222.0.66 "GET /compute/v2.1/servers/10e112a7-d70a-4499-8be4-fd5e4ab3ec17" status: 200 len: 1573 microversion: 2.1 time: 0.244065 Nov 22 12:25:25.925998 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 498/1061] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:25:25 2021] GET /compute/v2.1/servers/10e112a7-d70a-4499-8be4-fd5e4ab3ec17 => generated 1573 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:25:26.939351 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-58fa3333-5aaa-4106-be00-109e54224c36 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:25:26.939965 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-58fa3333-5aaa-4106-be00-109e54224c36 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: 496ce05f-ecc0-4dfd-b1d4-1c961f763af7] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:25:26.943763 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-c466da96-363e-44a1-bb62-37029ea31754 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:25:26.944363 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-c466da96-363e-44a1-bb62-37029ea31754 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] [instance: 10e112a7-d70a-4499-8be4-fd5e4ab3ec17] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:25:26.947063 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-58fa3333-5aaa-4106-be00-109e54224c36 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:26.947568 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-58fa3333-5aaa-4106-be00-109e54224c36 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:26.948365 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-58fa3333-5aaa-4106-be00-109e54224c36 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:26.948953 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-58fa3333-5aaa-4106-be00-109e54224c36 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:26.950342 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-c466da96-363e-44a1-bb62-37029ea31754 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:26.950793 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-c466da96-363e-44a1-bb62-37029ea31754 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:26.951621 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-c466da96-363e-44a1-bb62-37029ea31754 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:26.952048 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-c466da96-363e-44a1-bb62-37029ea31754 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:27.166905 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-58fa3333-5aaa-4106-be00-109e54224c36 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:25:27.170678 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-c466da96-363e-44a1-bb62-37029ea31754 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c15e2c2fa94be8b638f2257efb5820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575f4ae5262e4930b6658095a1aa8a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:25:27.176075 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-58fa3333-5aaa-4106-be00-109e54224c36 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:25:27.177626 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-58fa3333-5aaa-4106-be00-109e54224c36 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:25:27.178835 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-58fa3333-5aaa-4106-be00-109e54224c36 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "GET /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7" status: 200 len: 1721 microversion: 2.20 time: 0.243536 Nov 22 12:25:27.179010 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-c466da96-363e-44a1-bb62-37029ea31754 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] 10.222.0.66 "GET /compute/v2.1/servers/10e112a7-d70a-4499-8be4-fd5e4ab3ec17" status: 200 len: 1573 microversion: 2.1 time: 0.239571 Nov 22 12:25:27.179786 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 564/1062] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Nov 22 12:25:26 2021] GET /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7 => generated 1721 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 12:25:27.184854 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 499/1063] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:25:26 2021] GET /compute/v2.1/servers/10e112a7-d70a-4499-8be4-fd5e4ab3ec17 => generated 1573 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:25:27.284473 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-b7c86ac4-648f-48e6-a8d6-f6052f62be0a tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-271807768"}} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:25:27.285047 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-b7c86ac4-648f-48e6-a8d6-f6052f62be0a tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] [instance: 131dcb5b-f62d-42ec-b0d0-588a120aa1d3] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:25:27.292534 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-b7c86ac4-648f-48e6-a8d6-f6052f62be0a tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:27.293114 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-b7c86ac4-648f-48e6-a8d6-f6052f62be0a tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:27.293835 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-b7c86ac4-648f-48e6-a8d6-f6052f62be0a tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:27.294268 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-b7c86ac4-648f-48e6-a8d6-f6052f62be0a tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:27.441539 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.network.security_group_api [None req-b7c86ac4-648f-48e6-a8d6-f6052f62be0a tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Removing security group 6bde9ed8-9c6b-4c28-ae4a-506b5d391ae6 from port f7e46359-fc84-431c-88fd-b6af0c318ee6 Nov 22 12:25:27.823196 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-b7c86ac4-648f-48e6-a8d6-f6052f62be0a tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] 10.222.0.66 "POST /compute/v2.1/servers/131dcb5b-f62d-42ec-b0d0-588a120aa1d3/action" status: 202 len: 0 microversion: 2.1 time: 0.542790 Nov 22 12:25:27.824245 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 565/1064] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Nov 22 12:25:27 2021] POST /compute/v2.1/servers/131dcb5b-f62d-42ec-b0d0-588a120aa1d3/action => generated 0 bytes in 544 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 22 12:25:27.919436 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [req-4365c236-938c-4ffc-b0c8-9603eb0d7d4f req-85b92074-3a11-4a18-81d4-6349a9c5d493 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "131dcb5b-f62d-42ec-b0d0-588a120aa1d3", "tag": "f7e46359-fc84-431c-88fd-b6af0c318ee6"}]} {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:25:27.925865 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 12:25:27.925865 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: warnings.warn(msg) Nov 22 12:25:27.939289 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [req-4365c236-938c-4ffc-b0c8-9603eb0d7d4f req-85b92074-3a11-4a18-81d4-6349a9c5d493 service nova] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:27.942238 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [req-4365c236-938c-4ffc-b0c8-9603eb0d7d4f req-85b92074-3a11-4a18-81d4-6349a9c5d493 service nova] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:27.964056 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.compute.server_external_events [req-4365c236-938c-4ffc-b0c8-9603eb0d7d4f req-85b92074-3a11-4a18-81d4-6349a9c5d493 service nova] Creating event network-changed:f7e46359-fc84-431c-88fd-b6af0c318ee6 for instance 131dcb5b-f62d-42ec-b0d0-588a120aa1d3 on hv-cinder-76845 Nov 22 12:25:27.981479 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [req-4365c236-938c-4ffc-b0c8-9603eb0d7d4f req-85b92074-3a11-4a18-81d4-6349a9c5d493 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.144793 Nov 22 12:25:28.001524 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 500/1065] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Nov 22 12:25:27 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 12:25:28.013297 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-3aba1952-eb3b-4d4f-a951-b7ba80ba0065 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:25:28.013297 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-3aba1952-eb3b-4d4f-a951-b7ba80ba0065 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: 2306113c-8f98-42fd-8c0c-3dfac98fff21] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:25:28.025511 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-3aba1952-eb3b-4d4f-a951-b7ba80ba0065 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:28.026070 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-3aba1952-eb3b-4d4f-a951-b7ba80ba0065 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:28.028304 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-3aba1952-eb3b-4d4f-a951-b7ba80ba0065 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:28.030259 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-3aba1952-eb3b-4d4f-a951-b7ba80ba0065 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:28.110606 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-3aba1952-eb3b-4d4f-a951-b7ba80ba0065 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "GET /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.107009 Nov 22 12:25:28.111283 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 566/1066] 10.222.0.66 () {58 vars in 1301 bytes} [Mon Nov 22 12:25:28 2021] GET /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21/os-volume_attachments => generated 25 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 22 12:25:28.201993 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-d2d05094-3bdc-4c8a-ae60-d19f58875056 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:25:28.202703 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-d2d05094-3bdc-4c8a-ae60-d19f58875056 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] [instance: 10e112a7-d70a-4499-8be4-fd5e4ab3ec17] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:25:28.207538 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-42cb12f0-5132-40b0-838c-59b3b5abe9be tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:25:28.208193 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-42cb12f0-5132-40b0-838c-59b3b5abe9be tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: 496ce05f-ecc0-4dfd-b1d4-1c961f763af7] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:25:28.224225 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-42cb12f0-5132-40b0-838c-59b3b5abe9be tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:28.225089 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-d2d05094-3bdc-4c8a-ae60-d19f58875056 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:28.225553 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-d2d05094-3bdc-4c8a-ae60-d19f58875056 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:28.225753 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-42cb12f0-5132-40b0-838c-59b3b5abe9be tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:28.228431 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-42cb12f0-5132-40b0-838c-59b3b5abe9be tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:28.228916 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-d2d05094-3bdc-4c8a-ae60-d19f58875056 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:28.229370 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-d2d05094-3bdc-4c8a-ae60-d19f58875056 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:28.229922 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-42cb12f0-5132-40b0-838c-59b3b5abe9be tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:28.580048 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-42cb12f0-5132-40b0-838c-59b3b5abe9be tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:25:28.586384 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-d2d05094-3bdc-4c8a-ae60-d19f58875056 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c15e2c2fa94be8b638f2257efb5820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575f4ae5262e4930b6658095a1aa8a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:25:28.589044 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-42cb12f0-5132-40b0-838c-59b3b5abe9be tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:25:28.591258 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-42cb12f0-5132-40b0-838c-59b3b5abe9be tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:25:28.593007 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-42cb12f0-5132-40b0-838c-59b3b5abe9be tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "GET /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7" status: 200 len: 1721 microversion: 2.20 time: 0.398578 Nov 22 12:25:28.605302 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 567/1067] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Nov 22 12:25:28 2021] GET /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7 => generated 1721 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 12:25:28.610278 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-be226059-5d26-4d71-bedc-8020d8e491bb tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:25:28.610522 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-d2d05094-3bdc-4c8a-ae60-d19f58875056 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] 10.222.0.66 "GET /compute/v2.1/servers/10e112a7-d70a-4499-8be4-fd5e4ab3ec17" status: 200 len: 1560 microversion: 2.1 time: 0.416812 Nov 22 12:25:28.610837 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-be226059-5d26-4d71-bedc-8020d8e491bb tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: 2306113c-8f98-42fd-8c0c-3dfac98fff21] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:25:28.613696 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 501/1068] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:25:28 2021] GET /compute/v2.1/servers/10e112a7-d70a-4499-8be4-fd5e4ab3ec17 => generated 1560 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:25:28.621591 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-be226059-5d26-4d71-bedc-8020d8e491bb tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:28.622357 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-be226059-5d26-4d71-bedc-8020d8e491bb tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:28.623359 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-be226059-5d26-4d71-bedc-8020d8e491bb tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:28.623808 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-be226059-5d26-4d71-bedc-8020d8e491bb tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:28.653432 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-be226059-5d26-4d71-bedc-8020d8e491bb tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: 2306113c-8f98-42fd-8c0c-3dfac98fff21] Going to try to terminate instance {{(pid=116272) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 22 12:25:28.755364 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-be226059-5d26-4d71-bedc-8020d8e491bb tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "DELETE /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21" status: 204 len: 0 microversion: 2.1 time: 0.148595 Nov 22 12:25:28.756245 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 568/1069] 10.222.0.66 () {58 vars in 1238 bytes} [Mon Nov 22 12:25:28 2021] DELETE /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 22 12:25:28.766116 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-f7091be8-0742-4453-8452-de010efd6848 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:25:28.767339 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-f7091be8-0742-4453-8452-de010efd6848 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: 2306113c-8f98-42fd-8c0c-3dfac98fff21] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:25:28.774746 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-f7091be8-0742-4453-8452-de010efd6848 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:28.775186 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-f7091be8-0742-4453-8452-de010efd6848 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:28.776253 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-f7091be8-0742-4453-8452-de010efd6848 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:28.776892 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-f7091be8-0742-4453-8452-de010efd6848 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:28.947282 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-f7091be8-0742-4453-8452-de010efd6848 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41d885b9b854d8db11da5d325552301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f5dffe9bc3f41c7a2656d194fd02173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:25:28.955876 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-f7091be8-0742-4453-8452-de010efd6848 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "GET /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21" status: 200 len: 1673 microversion: 2.1 time: 0.193629 Nov 22 12:25:28.956464 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 502/1070] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:25:28 2021] GET /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21 => generated 1673 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:25:29.432325 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-d8211ddb-1aa2-4a5c-b487-96d24445fcec tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:25:29.433199 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [req-c64d2d96-d5d5-4520-b19c-b0ff42247b28 req-0169c970-92bc-445c-ac27-14f3f9c44057 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "131dcb5b-f62d-42ec-b0d0-588a120aa1d3", "tag": "f7e46359-fc84-431c-88fd-b6af0c318ee6"}]} {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:25:29.433853 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-d8211ddb-1aa2-4a5c-b487-96d24445fcec tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] [instance: 131dcb5b-f62d-42ec-b0d0-588a120aa1d3] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:25:29.434013 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 12:25:29.434013 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: warnings.warn(msg) Nov 22 12:25:29.440987 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-d8211ddb-1aa2-4a5c-b487-96d24445fcec tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:29.440987 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-d8211ddb-1aa2-4a5c-b487-96d24445fcec tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:29.441447 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [req-c64d2d96-d5d5-4520-b19c-b0ff42247b28 req-0169c970-92bc-445c-ac27-14f3f9c44057 service nova] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:29.441703 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [req-c64d2d96-d5d5-4520-b19c-b0ff42247b28 req-0169c970-92bc-445c-ac27-14f3f9c44057 service nova] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:29.441838 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-d8211ddb-1aa2-4a5c-b487-96d24445fcec tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:29.442162 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-d8211ddb-1aa2-4a5c-b487-96d24445fcec tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:29.454228 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.compute.server_external_events [req-c64d2d96-d5d5-4520-b19c-b0ff42247b28 req-0169c970-92bc-445c-ac27-14f3f9c44057 service nova] Creating event network-changed:f7e46359-fc84-431c-88fd-b6af0c318ee6 for instance 131dcb5b-f62d-42ec-b0d0-588a120aa1d3 on hv-cinder-76845 Nov 22 12:25:29.459281 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [req-c64d2d96-d5d5-4520-b19c-b0ff42247b28 req-0169c970-92bc-445c-ac27-14f3f9c44057 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030409 Nov 22 12:25:29.459966 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 503/1071] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Nov 22 12:25:29 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 22 12:25:29.548867 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.objects.instance [None req-d8211ddb-1aa2-4a5c-b487-96d24445fcec tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lazy-loading 'services' on Instance uuid 131dcb5b-f62d-42ec-b0d0-588a120aa1d3 {{(pid=116272) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 22 12:25:29.613682 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-1f463f9b-9c1d-4a43-9c88-57ddf331b91d tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:25:29.614496 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-1f463f9b-9c1d-4a43-9c88-57ddf331b91d tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: 496ce05f-ecc0-4dfd-b1d4-1c961f763af7] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:25:29.623923 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-1f463f9b-9c1d-4a43-9c88-57ddf331b91d tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:29.624371 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-1f463f9b-9c1d-4a43-9c88-57ddf331b91d tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:29.625408 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-1f463f9b-9c1d-4a43-9c88-57ddf331b91d tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:29.626391 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-1f463f9b-9c1d-4a43-9c88-57ddf331b91d tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:29.643268 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-d8211ddb-1aa2-4a5c-b487-96d24445fcec tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] 10.222.0.66 "DELETE /compute/v2.1/servers/131dcb5b-f62d-42ec-b0d0-588a120aa1d3/os-volume_attachments/c38a2195-0d58-4131-9e72-de7f25458c99" status: 202 len: 0 microversion: 2.1 time: 0.215603 Nov 22 12:25:29.645163 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 569/1072] 10.222.0.66 () {58 vars in 1415 bytes} [Mon Nov 22 12:25:29 2021] DELETE /compute/v2.1/servers/131dcb5b-f62d-42ec-b0d0-588a120aa1d3/os-volume_attachments/c38a2195-0d58-4131-9e72-de7f25458c99 => generated 0 bytes in 220 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 22 12:25:29.666318 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-666b90a7-7f24-4b51-9faf-504b9fb8b7d7 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:25:29.669502 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-666b90a7-7f24-4b51-9faf-504b9fb8b7d7 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] [instance: 131dcb5b-f62d-42ec-b0d0-588a120aa1d3] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:25:29.688273 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-666b90a7-7f24-4b51-9faf-504b9fb8b7d7 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:29.689099 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-666b90a7-7f24-4b51-9faf-504b9fb8b7d7 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:29.689950 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-666b90a7-7f24-4b51-9faf-504b9fb8b7d7 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:29.690632 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-666b90a7-7f24-4b51-9faf-504b9fb8b7d7 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:29.733637 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-666b90a7-7f24-4b51-9faf-504b9fb8b7d7 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] 10.222.0.66 "GET /compute/v2.1/servers/131dcb5b-f62d-42ec-b0d0-588a120aa1d3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.084172 Nov 22 12:25:29.734348 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 570/1073] 10.222.0.66 () {58 vars in 1301 bytes} [Mon Nov 22 12:25:29 2021] GET /compute/v2.1/servers/131dcb5b-f62d-42ec-b0d0-588a120aa1d3/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 12:25:29.885541 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-1f463f9b-9c1d-4a43-9c88-57ddf331b91d tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:25:29.894999 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-1f463f9b-9c1d-4a43-9c88-57ddf331b91d tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:25:29.896544 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-1f463f9b-9c1d-4a43-9c88-57ddf331b91d tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:25:29.897754 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-1f463f9b-9c1d-4a43-9c88-57ddf331b91d tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "GET /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7" status: 200 len: 1721 microversion: 2.20 time: 0.288609 Nov 22 12:25:29.898295 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 504/1074] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Nov 22 12:25:29 2021] GET /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7 => generated 1721 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 12:25:29.975348 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-5f66da67-cf9e-4071-8573-14510fb5f161 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:25:29.976381 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-5f66da67-cf9e-4071-8573-14510fb5f161 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: 2306113c-8f98-42fd-8c0c-3dfac98fff21] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:25:29.984726 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-5f66da67-cf9e-4071-8573-14510fb5f161 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:29.985284 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-5f66da67-cf9e-4071-8573-14510fb5f161 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:29.986869 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-5f66da67-cf9e-4071-8573-14510fb5f161 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:29.987570 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-5f66da67-cf9e-4071-8573-14510fb5f161 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:30.419706 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-5f66da67-cf9e-4071-8573-14510fb5f161 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41d885b9b854d8db11da5d325552301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f5dffe9bc3f41c7a2656d194fd02173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:25:30.429565 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-5f66da67-cf9e-4071-8573-14510fb5f161 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "GET /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21" status: 200 len: 1673 microversion: 2.1 time: 0.458893 Nov 22 12:25:30.439506 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 571/1075] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:25:29 2021] GET /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21 => generated 1673 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 12:25:30.745953 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-025b8e7b-eb68-46bb-be85-18d0a0076c9a tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:25:30.746930 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-025b8e7b-eb68-46bb-be85-18d0a0076c9a tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] [instance: 131dcb5b-f62d-42ec-b0d0-588a120aa1d3] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:25:30.754321 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-025b8e7b-eb68-46bb-be85-18d0a0076c9a tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:30.754752 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-025b8e7b-eb68-46bb-be85-18d0a0076c9a tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:30.755849 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-025b8e7b-eb68-46bb-be85-18d0a0076c9a tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:30.756279 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-025b8e7b-eb68-46bb-be85-18d0a0076c9a tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:30.800239 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-025b8e7b-eb68-46bb-be85-18d0a0076c9a tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] 10.222.0.66 "GET /compute/v2.1/servers/131dcb5b-f62d-42ec-b0d0-588a120aa1d3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.057725 Nov 22 12:25:30.801331 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 505/1076] 10.222.0.66 () {58 vars in 1301 bytes} [Mon Nov 22 12:25:30 2021] GET /compute/v2.1/servers/131dcb5b-f62d-42ec-b0d0-588a120aa1d3/os-volume_attachments => generated 25 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 22 12:25:30.815510 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-5de0246b-a68e-4a58-87e0-1b3b70ee2fed tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:25:30.816015 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-5de0246b-a68e-4a58-87e0-1b3b70ee2fed tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] [instance: 131dcb5b-f62d-42ec-b0d0-588a120aa1d3] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:25:30.823026 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-5de0246b-a68e-4a58-87e0-1b3b70ee2fed tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:30.823522 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-5de0246b-a68e-4a58-87e0-1b3b70ee2fed tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:30.824520 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-5de0246b-a68e-4a58-87e0-1b3b70ee2fed tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:30.825025 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-5de0246b-a68e-4a58-87e0-1b3b70ee2fed tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:30.919075 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.wsgi [None req-5de0246b-a68e-4a58-87e0-1b3b70ee2fed tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] HTTP exception thrown: Instance 131dcb5b-f62d-42ec-b0d0-588a120aa1d3 is not attached to volume c38a2195-0d58-4131-9e72-de7f25458c99 Nov 22 12:25:30.920076 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-f2f9688c-32e2-4293-96d2-f969ea0b4a00 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:25:30.920222 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-5de0246b-a68e-4a58-87e0-1b3b70ee2fed tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Returning 404 to user: Instance 131dcb5b-f62d-42ec-b0d0-588a120aa1d3 is not attached to volume c38a2195-0d58-4131-9e72-de7f25458c99 {{(pid=116272) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 12:25:30.921073 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-f2f9688c-32e2-4293-96d2-f969ea0b4a00 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: 496ce05f-ecc0-4dfd-b1d4-1c961f763af7] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:25:30.921509 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-5de0246b-a68e-4a58-87e0-1b3b70ee2fed tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] 10.222.0.66 "DELETE /compute/v2.1/servers/131dcb5b-f62d-42ec-b0d0-588a120aa1d3/os-volume_attachments/c38a2195-0d58-4131-9e72-de7f25458c99" status: 404 len: 154 microversion: 2.1 time: 0.110885 Nov 22 12:25:30.922440 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 572/1077] 10.222.0.66 () {58 vars in 1415 bytes} [Mon Nov 22 12:25:30 2021] DELETE /compute/v2.1/servers/131dcb5b-f62d-42ec-b0d0-588a120aa1d3/os-volume_attachments/c38a2195-0d58-4131-9e72-de7f25458c99 => generated 154 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 22 12:25:30.935269 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-f2f9688c-32e2-4293-96d2-f969ea0b4a00 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:30.935975 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-f2f9688c-32e2-4293-96d2-f969ea0b4a00 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:30.937309 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-f2f9688c-32e2-4293-96d2-f969ea0b4a00 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:30.938051 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-f2f9688c-32e2-4293-96d2-f969ea0b4a00 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:31.091701 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-f2f9688c-32e2-4293-96d2-f969ea0b4a00 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:25:31.105795 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-f2f9688c-32e2-4293-96d2-f969ea0b4a00 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:25:31.107360 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-f2f9688c-32e2-4293-96d2-f969ea0b4a00 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:25:31.108578 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-f2f9688c-32e2-4293-96d2-f969ea0b4a00 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "GET /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7" status: 200 len: 1721 microversion: 2.20 time: 0.195508 Nov 22 12:25:31.109213 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 506/1078] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Nov 22 12:25:30 2021] GET /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7 => generated 1721 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 22 12:25:31.360934 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [req-bc01e649-b7e3-49ad-8207-c85072c4bc99 req-c2924e7e-0556-4353-8eea-8ab69cab9c63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10e112a7-d70a-4499-8be4-fd5e4ab3ec17", "name": "network-vif-plugged", "status": "completed", "tag": "c27e22cf-346f-4a81-8e7d-d2418b4df811"}]} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:25:31.364159 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 12:25:31.364159 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: warnings.warn(msg) Nov 22 12:25:31.375890 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [req-bc01e649-b7e3-49ad-8207-c85072c4bc99 req-c2924e7e-0556-4353-8eea-8ab69cab9c63 service nova] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:31.376824 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [req-bc01e649-b7e3-49ad-8207-c85072c4bc99 req-c2924e7e-0556-4353-8eea-8ab69cab9c63 service nova] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:31.398266 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.compute.server_external_events [req-bc01e649-b7e3-49ad-8207-c85072c4bc99 req-c2924e7e-0556-4353-8eea-8ab69cab9c63 service nova] Creating event network-vif-plugged:c27e22cf-346f-4a81-8e7d-d2418b4df811 for instance 10e112a7-d70a-4499-8be4-fd5e4ab3ec17 on hv-cinder-76845 Nov 22 12:25:31.408472 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [req-bc01e649-b7e3-49ad-8207-c85072c4bc99 req-c2924e7e-0556-4353-8eea-8ab69cab9c63 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052892 Nov 22 12:25:31.409651 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 573/1079] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Nov 22 12:25:31 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 12:25:31.450763 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-245bc75f-a362-478e-9c35-5e02e41d11a1 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:25:31.452431 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-245bc75f-a362-478e-9c35-5e02e41d11a1 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: 2306113c-8f98-42fd-8c0c-3dfac98fff21] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:25:31.460387 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-245bc75f-a362-478e-9c35-5e02e41d11a1 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:31.460965 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-245bc75f-a362-478e-9c35-5e02e41d11a1 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:31.462038 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-245bc75f-a362-478e-9c35-5e02e41d11a1 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:31.462570 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-245bc75f-a362-478e-9c35-5e02e41d11a1 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:31.727313 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-245bc75f-a362-478e-9c35-5e02e41d11a1 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41d885b9b854d8db11da5d325552301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f5dffe9bc3f41c7a2656d194fd02173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:25:31.735386 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-245bc75f-a362-478e-9c35-5e02e41d11a1 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "GET /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21" status: 200 len: 1673 microversion: 2.1 time: 0.291455 Nov 22 12:25:31.736036 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 507/1080] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:25:31 2021] GET /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21 => generated 1673 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:25:32.095701 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-dc3d5d01-b221-4f52-a329-426f6959821b tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:25:32.096319 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-dc3d5d01-b221-4f52-a329-426f6959821b tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] [instance: 131dcb5b-f62d-42ec-b0d0-588a120aa1d3] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:25:32.102834 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-dc3d5d01-b221-4f52-a329-426f6959821b tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:32.103320 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-dc3d5d01-b221-4f52-a329-426f6959821b tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:32.104120 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-dc3d5d01-b221-4f52-a329-426f6959821b tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:32.104554 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-dc3d5d01-b221-4f52-a329-426f6959821b tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:32.132291 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-dc3d5d01-b221-4f52-a329-426f6959821b tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] [instance: 131dcb5b-f62d-42ec-b0d0-588a120aa1d3] Going to try to terminate instance {{(pid=116272) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 22 12:25:32.133992 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-334a3989-2c11-4942-9d38-b712d08f8b6e tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:25:32.134581 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-334a3989-2c11-4942-9d38-b712d08f8b6e tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: 496ce05f-ecc0-4dfd-b1d4-1c961f763af7] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:25:32.142877 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-334a3989-2c11-4942-9d38-b712d08f8b6e tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:32.143774 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-334a3989-2c11-4942-9d38-b712d08f8b6e tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:32.144919 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-334a3989-2c11-4942-9d38-b712d08f8b6e tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:32.145527 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-334a3989-2c11-4942-9d38-b712d08f8b6e tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:32.231020 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-dc3d5d01-b221-4f52-a329-426f6959821b tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] 10.222.0.66 "DELETE /compute/v2.1/servers/131dcb5b-f62d-42ec-b0d0-588a120aa1d3" status: 204 len: 0 microversion: 2.1 time: 0.140120 Nov 22 12:25:32.232947 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 574/1081] 10.222.0.66 () {58 vars in 1238 bytes} [Mon Nov 22 12:25:32 2021] DELETE /compute/v2.1/servers/131dcb5b-f62d-42ec-b0d0-588a120aa1d3 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 22 12:25:32.247380 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-33758d88-49fe-4e38-82b4-0a40a1eb0ff5 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:25:32.247380 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-33758d88-49fe-4e38-82b4-0a40a1eb0ff5 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] [instance: 131dcb5b-f62d-42ec-b0d0-588a120aa1d3] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:25:32.268416 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-33758d88-49fe-4e38-82b4-0a40a1eb0ff5 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:32.268788 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-33758d88-49fe-4e38-82b4-0a40a1eb0ff5 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:32.270440 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-33758d88-49fe-4e38-82b4-0a40a1eb0ff5 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:32.270888 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-33758d88-49fe-4e38-82b4-0a40a1eb0ff5 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:32.453624 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-334a3989-2c11-4942-9d38-b712d08f8b6e tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:25:32.462637 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-334a3989-2c11-4942-9d38-b712d08f8b6e tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:25:32.464821 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-334a3989-2c11-4942-9d38-b712d08f8b6e tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:25:32.466483 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-334a3989-2c11-4942-9d38-b712d08f8b6e tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "GET /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7" status: 200 len: 1721 microversion: 2.20 time: 0.336236 Nov 22 12:25:32.467731 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 508/1082] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Nov 22 12:25:32 2021] GET /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7 => generated 1721 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 22 12:25:32.478431 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [req-e73a62ec-989c-4daf-9c27-a1d8639ebc09 req-027c563c-d025-460c-9f68-646976d8acea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2306113c-8f98-42fd-8c0c-3dfac98fff21", "name": "network-vif-deleted", "tag": "0b19f5ef-ff09-43ae-866e-7b3d6c9fc45c"}]} {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:25:32.480331 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 12:25:32.480331 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: warnings.warn(msg) Nov 22 12:25:32.495949 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [req-e73a62ec-989c-4daf-9c27-a1d8639ebc09 req-027c563c-d025-460c-9f68-646976d8acea service nova] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:32.496822 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [req-e73a62ec-989c-4daf-9c27-a1d8639ebc09 req-027c563c-d025-460c-9f68-646976d8acea service nova] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:32.510599 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.compute.server_external_events [req-e73a62ec-989c-4daf-9c27-a1d8639ebc09 req-027c563c-d025-460c-9f68-646976d8acea service nova] Creating event network-vif-deleted:0b19f5ef-ff09-43ae-866e-7b3d6c9fc45c for instance 2306113c-8f98-42fd-8c0c-3dfac98fff21 on hv-cinder-76845 Nov 22 12:25:32.519132 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [req-e73a62ec-989c-4daf-9c27-a1d8639ebc09 req-027c563c-d025-460c-9f68-646976d8acea service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048281 Nov 22 12:25:32.520271 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 509/1083] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Nov 22 12:25:32 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 12:25:32.540808 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-33758d88-49fe-4e38-82b4-0a40a1eb0ff5 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc2a99b8e8f244aab8bd6545355ee044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b282b4e5e2147a692e990f45ce44b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:25:32.550139 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-33758d88-49fe-4e38-82b4-0a40a1eb0ff5 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] 10.222.0.66 "GET /compute/v2.1/servers/131dcb5b-f62d-42ec-b0d0-588a120aa1d3" status: 200 len: 1554 microversion: 2.1 time: 0.311801 Nov 22 12:25:32.551085 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 575/1084] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:25:32 2021] GET /compute/v2.1/servers/131dcb5b-f62d-42ec-b0d0-588a120aa1d3 => generated 1554 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 12:25:32.753411 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-237905f9-1884-4e4e-9f29-7fada4ad330a tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:25:32.754156 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-237905f9-1884-4e4e-9f29-7fada4ad330a tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: 2306113c-8f98-42fd-8c0c-3dfac98fff21] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:25:32.762740 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-237905f9-1884-4e4e-9f29-7fada4ad330a tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:32.763502 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-237905f9-1884-4e4e-9f29-7fada4ad330a tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:32.766359 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-237905f9-1884-4e4e-9f29-7fada4ad330a tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:32.767099 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-237905f9-1884-4e4e-9f29-7fada4ad330a tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:32.807372 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-237905f9-1884-4e4e-9f29-7fada4ad330a tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:32.807810 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-237905f9-1884-4e4e-9f29-7fada4ad330a tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:32.808273 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.objects.instance [None req-237905f9-1884-4e4e-9f29-7fada4ad330a tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lazy-loading 'fault' on Instance uuid 2306113c-8f98-42fd-8c0c-3dfac98fff21 {{(pid=116273) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 22 12:25:32.879988 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-237905f9-1884-4e4e-9f29-7fada4ad330a tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41d885b9b854d8db11da5d325552301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f5dffe9bc3f41c7a2656d194fd02173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:25:32.894407 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-237905f9-1884-4e4e-9f29-7fada4ad330a tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "GET /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21" status: 200 len: 1327 microversion: 2.1 time: 0.144780 Nov 22 12:25:32.895474 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 510/1085] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:25:32 2021] GET /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21 => generated 1327 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:25:33.489045 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-36217712-f5b1-4f1b-a2be-7243fc3be43b tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:25:33.490267 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-36217712-f5b1-4f1b-a2be-7243fc3be43b tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: 496ce05f-ecc0-4dfd-b1d4-1c961f763af7] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:25:33.502419 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-36217712-f5b1-4f1b-a2be-7243fc3be43b tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:33.503055 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-36217712-f5b1-4f1b-a2be-7243fc3be43b tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:33.504599 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-36217712-f5b1-4f1b-a2be-7243fc3be43b tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:33.505357 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-36217712-f5b1-4f1b-a2be-7243fc3be43b tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:33.573288 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-1932ba55-93ed-4d43-9e40-77993b1fa02a tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:25:33.574375 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-1932ba55-93ed-4d43-9e40-77993b1fa02a tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] [instance: 131dcb5b-f62d-42ec-b0d0-588a120aa1d3] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:25:33.583073 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-1932ba55-93ed-4d43-9e40-77993b1fa02a tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:33.583953 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-1932ba55-93ed-4d43-9e40-77993b1fa02a tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:33.585053 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-1932ba55-93ed-4d43-9e40-77993b1fa02a tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:33.585647 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-1932ba55-93ed-4d43-9e40-77993b1fa02a tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:33.694858 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-36217712-f5b1-4f1b-a2be-7243fc3be43b tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:25:33.705452 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-36217712-f5b1-4f1b-a2be-7243fc3be43b tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:25:33.706840 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-36217712-f5b1-4f1b-a2be-7243fc3be43b tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:25:33.710068 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-36217712-f5b1-4f1b-a2be-7243fc3be43b tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "GET /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7" status: 200 len: 1721 microversion: 2.20 time: 0.227143 Nov 22 12:25:33.711546 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 576/1086] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Nov 22 12:25:33 2021] GET /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7 => generated 1721 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 12:25:33.783152 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-1932ba55-93ed-4d43-9e40-77993b1fa02a tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc2a99b8e8f244aab8bd6545355ee044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b282b4e5e2147a692e990f45ce44b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:25:33.792584 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-1932ba55-93ed-4d43-9e40-77993b1fa02a tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] 10.222.0.66 "GET /compute/v2.1/servers/131dcb5b-f62d-42ec-b0d0-588a120aa1d3" status: 200 len: 1554 microversion: 2.1 time: 0.226098 Nov 22 12:25:33.793187 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 511/1087] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:25:33 2021] GET /compute/v2.1/servers/131dcb5b-f62d-42ec-b0d0-588a120aa1d3 => generated 1554 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:25:33.917757 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-69f730e8-287f-4208-85d6-f70aa1de815a tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:25:33.918286 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-69f730e8-287f-4208-85d6-f70aa1de815a tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: 2306113c-8f98-42fd-8c0c-3dfac98fff21] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:25:33.925063 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-69f730e8-287f-4208-85d6-f70aa1de815a tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:33.925526 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-69f730e8-287f-4208-85d6-f70aa1de815a tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:33.926340 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-69f730e8-287f-4208-85d6-f70aa1de815a tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:33.926776 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-69f730e8-287f-4208-85d6-f70aa1de815a tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:33.943725 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.wsgi [None req-69f730e8-287f-4208-85d6-f70aa1de815a tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] HTTP exception thrown: Instance 2306113c-8f98-42fd-8c0c-3dfac98fff21 could not be found. Nov 22 12:25:33.944329 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-69f730e8-287f-4208-85d6-f70aa1de815a tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Returning 404 to user: Instance 2306113c-8f98-42fd-8c0c-3dfac98fff21 could not be found. {{(pid=116272) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 12:25:33.945170 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-69f730e8-287f-4208-85d6-f70aa1de815a tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "GET /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21" status: 404 len: 111 microversion: 2.1 time: 0.031611 Nov 22 12:25:33.945708 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 577/1088] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:25:33 2021] GET /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 22 12:25:33.955934 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-4b734618-7c3b-4980-926a-aae1721bf963 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Calling method '.version_select at 0x7fa1a3ecb040>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:25:33.979423 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-4b734618-7c3b-4980-926a-aae1721bf963 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-940633463" status: 202 len: 0 microversion: 2.1 time: 0.027685 Nov 22 12:25:33.980125 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 512/1089] 10.222.0.66 () {58 vars in 1217 bytes} [Mon Nov 22 12:25:33 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-940633463 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 22 12:25:34.693103 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [req-19e440e6-ba10-44ca-a5fe-dcd606e1b3b8 req-5d443cf7-40f9-416a-9964-79187fb50a9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "131dcb5b-f62d-42ec-b0d0-588a120aa1d3", "name": "network-vif-deleted", "tag": "f7e46359-fc84-431c-88fd-b6af0c318ee6"}]} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:25:34.694629 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 12:25:34.694629 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: warnings.warn(msg) Nov 22 12:25:34.706791 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [req-19e440e6-ba10-44ca-a5fe-dcd606e1b3b8 req-5d443cf7-40f9-416a-9964-79187fb50a9d service nova] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:34.706791 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [req-19e440e6-ba10-44ca-a5fe-dcd606e1b3b8 req-5d443cf7-40f9-416a-9964-79187fb50a9d service nova] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:34.728909 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.compute.server_external_events [req-19e440e6-ba10-44ca-a5fe-dcd606e1b3b8 req-5d443cf7-40f9-416a-9964-79187fb50a9d service nova] Creating event network-vif-deleted:f7e46359-fc84-431c-88fd-b6af0c318ee6 for instance 131dcb5b-f62d-42ec-b0d0-588a120aa1d3 on hv-cinder-76845 Nov 22 12:25:34.736809 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [req-19e440e6-ba10-44ca-a5fe-dcd606e1b3b8 req-5d443cf7-40f9-416a-9964-79187fb50a9d service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047586 Nov 22 12:25:34.738390 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 578/1090] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Nov 22 12:25:34 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 22 12:25:34.740765 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-9e33d769-b0bc-472b-9b22-83e6b6b0fe70 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:25:34.741797 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-9e33d769-b0bc-472b-9b22-83e6b6b0fe70 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: 496ce05f-ecc0-4dfd-b1d4-1c961f763af7] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:25:34.761430 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-9e33d769-b0bc-472b-9b22-83e6b6b0fe70 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:34.762103 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-9e33d769-b0bc-472b-9b22-83e6b6b0fe70 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:34.764288 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-9e33d769-b0bc-472b-9b22-83e6b6b0fe70 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:34.765054 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-9e33d769-b0bc-472b-9b22-83e6b6b0fe70 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:34.777343 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-73544250-c926-4bec-bc96-f00b5f186f9e tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Action: 'create', calling method: .version_select at 0x7fa1a3336dc0>, body: {"keypair": {"name": "tempest-keypair-265908318"}} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:25:34.802207 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.quota [None req-73544250-c926-4bec-bc96-f00b5f186f9e tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Getting quotas for project 7f5dffe9bc3f41c7a2656d194fd02173. Resources: {'key_pairs'} {{(pid=116272) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 22 12:25:34.812516 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.quota [None req-73544250-c926-4bec-bc96-f00b5f186f9e tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Getting quotas for user b41d885b9b854d8db11da5d325552301 and project 7f5dffe9bc3f41c7a2656d194fd02173. Resources: {'key_pairs'} {{(pid=116272) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 22 12:25:34.946835 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-9e33d769-b0bc-472b-9b22-83e6b6b0fe70 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:25:34.955847 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-9e33d769-b0bc-472b-9b22-83e6b6b0fe70 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:25:34.957327 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-9e33d769-b0bc-472b-9b22-83e6b6b0fe70 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:25:34.958525 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-9e33d769-b0bc-472b-9b22-83e6b6b0fe70 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "GET /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7" status: 200 len: 1742 microversion: 2.20 time: 0.231671 Nov 22 12:25:34.959116 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 513/1091] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Nov 22 12:25:34 2021] GET /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7 => generated 1742 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 12:25:34.963455 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-6850e0e9-f74d-4fcc-b169-9a2d128bb450 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:25:34.964058 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-6850e0e9-f74d-4fcc-b169-9a2d128bb450 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] [instance: 131dcb5b-f62d-42ec-b0d0-588a120aa1d3] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:25:34.970610 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-6850e0e9-f74d-4fcc-b169-9a2d128bb450 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:34.971060 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-6850e0e9-f74d-4fcc-b169-9a2d128bb450 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:34.971957 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-6850e0e9-f74d-4fcc-b169-9a2d128bb450 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:34.972596 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-6850e0e9-f74d-4fcc-b169-9a2d128bb450 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:35.010940 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-6850e0e9-f74d-4fcc-b169-9a2d128bb450 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:35.011455 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-6850e0e9-f74d-4fcc-b169-9a2d128bb450 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:35.011934 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.objects.instance [None req-6850e0e9-f74d-4fcc-b169-9a2d128bb450 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lazy-loading 'fault' on Instance uuid 131dcb5b-f62d-42ec-b0d0-588a120aa1d3 {{(pid=116273) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 22 12:25:35.062284 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-6850e0e9-f74d-4fcc-b169-9a2d128bb450 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc2a99b8e8f244aab8bd6545355ee044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b282b4e5e2147a692e990f45ce44b8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:25:35.074362 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-6850e0e9-f74d-4fcc-b169-9a2d128bb450 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] 10.222.0.66 "GET /compute/v2.1/servers/131dcb5b-f62d-42ec-b0d0-588a120aa1d3" status: 200 len: 1347 microversion: 2.1 time: 0.113807 Nov 22 12:25:35.075658 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 514/1092] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:25:34 2021] GET /compute/v2.1/servers/131dcb5b-f62d-42ec-b0d0-588a120aa1d3 => generated 1347 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:25:35.149777 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.quota [None req-73544250-c926-4bec-bc96-f00b5f186f9e tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Getting quotas for project 7f5dffe9bc3f41c7a2656d194fd02173. Resources: {'key_pairs'} {{(pid=116272) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 22 12:25:35.154538 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.quota [None req-73544250-c926-4bec-bc96-f00b5f186f9e tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Getting quotas for user b41d885b9b854d8db11da5d325552301 and project 7f5dffe9bc3f41c7a2656d194fd02173. Resources: {'key_pairs'} {{(pid=116272) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 22 12:25:35.172401 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-73544250-c926-4bec-bc96-f00b5f186f9e tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 0.402528 Nov 22 12:25:35.173285 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 579/1093] 10.222.0.66 () {60 vars in 1157 bytes} [Mon Nov 22 12:25:34 2021] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 12:25:35.981454 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-c1505677-cf39-4e14-a531-c86fd8cbb8aa tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:25:35.982094 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-c1505677-cf39-4e14-a531-c86fd8cbb8aa tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: 496ce05f-ecc0-4dfd-b1d4-1c961f763af7] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:25:35.990133 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-c1505677-cf39-4e14-a531-c86fd8cbb8aa tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:35.990591 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-c1505677-cf39-4e14-a531-c86fd8cbb8aa tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:35.991453 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-c1505677-cf39-4e14-a531-c86fd8cbb8aa tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:35.991986 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-c1505677-cf39-4e14-a531-c86fd8cbb8aa tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:36.099190 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-e9f3f9bc-c919-4a2b-a795-a55c24d09ef5 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:25:36.099978 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-e9f3f9bc-c919-4a2b-a795-a55c24d09ef5 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] [instance: 131dcb5b-f62d-42ec-b0d0-588a120aa1d3] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:25:36.110843 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-e9f3f9bc-c919-4a2b-a795-a55c24d09ef5 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:36.111310 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-e9f3f9bc-c919-4a2b-a795-a55c24d09ef5 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:36.112324 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-e9f3f9bc-c919-4a2b-a795-a55c24d09ef5 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:36.112929 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-e9f3f9bc-c919-4a2b-a795-a55c24d09ef5 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:36.129201 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.wsgi [None req-e9f3f9bc-c919-4a2b-a795-a55c24d09ef5 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] HTTP exception thrown: Instance 131dcb5b-f62d-42ec-b0d0-588a120aa1d3 could not be found. Nov 22 12:25:36.130393 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-e9f3f9bc-c919-4a2b-a795-a55c24d09ef5 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Returning 404 to user: Instance 131dcb5b-f62d-42ec-b0d0-588a120aa1d3 could not be found. {{(pid=116272) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 12:25:36.131481 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-e9f3f9bc-c919-4a2b-a795-a55c24d09ef5 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] 10.222.0.66 "GET /compute/v2.1/servers/131dcb5b-f62d-42ec-b0d0-588a120aa1d3" status: 404 len: 111 microversion: 2.1 time: 0.036644 Nov 22 12:25:36.132526 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 580/1094] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:25:36 2021] GET /compute/v2.1/servers/131dcb5b-f62d-42ec-b0d0-588a120aa1d3 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 22 12:25:36.145451 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-a8f2a192-dab0-42a0-a7a7-2a19d611f919 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] Calling method '.version_select at 0x7fa1ac40aee0>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:25:36.186254 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-a8f2a192-dab0-42a0-a7a7-2a19d611f919 tempest-TestMinimumBasicScenario-1001353867 tempest-TestMinimumBasicScenario-1001353867-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-174317760" status: 202 len: 0 microversion: 2.1 time: 0.048733 Nov 22 12:25:36.187953 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 581/1095] 10.222.0.66 () {58 vars in 1268 bytes} [Mon Nov 22 12:25:36 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-174317760 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 22 12:25:36.250104 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-c1505677-cf39-4e14-a531-c86fd8cbb8aa tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:25:36.260096 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-c1505677-cf39-4e14-a531-c86fd8cbb8aa tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:25:36.261583 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-c1505677-cf39-4e14-a531-c86fd8cbb8aa tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:25:36.271624 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-c1505677-cf39-4e14-a531-c86fd8cbb8aa tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "GET /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7" status: 200 len: 1737 microversion: 2.20 time: 0.290429 Nov 22 12:25:36.272761 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 515/1096] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Nov 22 12:25:35 2021] GET /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7 => generated 1737 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 12:25:37.011685 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-944e7534-4b63-4199-8c25-bc8ed9650108 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2065151570", "imageRef": "31affc49-b6f0-44da-af65-4c65d72458b9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "10b712e1-1243-4ece-87db-2201cf5a5198"}], "security_groups": [{"name": "tempest-securitygroup--1212079809"}], "key_name": "tempest-keypair-265908318", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:25:37.273555 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.network.neutron [None req-944e7534-4b63-4199-8c25-bc8ed9650108 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] validate_networks() for [('10b712e1-1243-4ece-87db-2201cf5a5198', None, None, None, None, None)] {{(pid=116272) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 22 12:25:37.293705 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-823a6570-03ce-4de3-a6b4-eefc0df25469 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:25:37.295072 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-823a6570-03ce-4de3-a6b4-eefc0df25469 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: 496ce05f-ecc0-4dfd-b1d4-1c961f763af7] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:25:37.311620 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-823a6570-03ce-4de3-a6b4-eefc0df25469 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:37.312372 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-823a6570-03ce-4de3-a6b4-eefc0df25469 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:37.314516 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-823a6570-03ce-4de3-a6b4-eefc0df25469 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:37.317997 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-823a6570-03ce-4de3-a6b4-eefc0df25469 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:37.667151 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-823a6570-03ce-4de3-a6b4-eefc0df25469 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:25:37.676012 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-823a6570-03ce-4de3-a6b4-eefc0df25469 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:25:37.677505 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-823a6570-03ce-4de3-a6b4-eefc0df25469 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:25:37.678688 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-823a6570-03ce-4de3-a6b4-eefc0df25469 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "GET /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7" status: 200 len: 1737 microversion: 2.20 time: 0.391259 Nov 22 12:25:37.695609 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 516/1097] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Nov 22 12:25:37 2021] GET /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7 => generated 1737 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 12:25:38.145980 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.virt.hardware [None req-944e7534-4b63-4199-8c25-bc8ed9650108 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Flavor limits 0:0:0 {{(pid=116272) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 22 12:25:38.146928 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.virt.hardware [None req-944e7534-4b63-4199-8c25-bc8ed9650108 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Image limits 0:0:0 {{(pid=116272) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 22 12:25:38.147611 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.virt.hardware [None req-944e7534-4b63-4199-8c25-bc8ed9650108 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Flavor pref 0:0:0 {{(pid=116272) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 22 12:25:38.148218 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.virt.hardware [None req-944e7534-4b63-4199-8c25-bc8ed9650108 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Image pref 0:0:0 {{(pid=116272) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 22 12:25:38.148790 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.virt.hardware [None req-944e7534-4b63-4199-8c25-bc8ed9650108 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116272) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 22 12:25:38.160718 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-944e7534-4b63-4199-8c25-bc8ed9650108 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:38.161171 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-944e7534-4b63-4199-8c25-bc8ed9650108 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:38.162036 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-944e7534-4b63-4199-8c25-bc8ed9650108 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:38.162480 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-944e7534-4b63-4199-8c25-bc8ed9650108 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:38.184464 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.quota [None req-944e7534-4b63-4199-8c25-bc8ed9650108 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Getting quotas for project 7f5dffe9bc3f41c7a2656d194fd02173. Resources: {'ram', 'instances', 'cores'} {{(pid=116272) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 22 12:25:38.190104 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.quota [None req-944e7534-4b63-4199-8c25-bc8ed9650108 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Getting quotas for user b41d885b9b854d8db11da5d325552301 and project 7f5dffe9bc3f41c7a2656d194fd02173. Resources: {'ram', 'instances', 'cores'} {{(pid=116272) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 22 12:25:38.206053 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-944e7534-4b63-4199-8c25-bc8ed9650108 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Going to run 1 instances... {{(pid=116272) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 22 12:25:38.209235 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-944e7534-4b63-4199-8c25-bc8ed9650108 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: e5d549b4-7eb7-4cdd-90f0-ead23b7df090] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='31affc49-b6f0-44da-af65-4c65d72458b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116272) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 22 12:25:38.298849 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-944e7534-4b63-4199-8c25-bc8ed9650108 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.291286 Nov 22 12:25:38.300450 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 582/1098] 10.222.0.66 () {60 vars in 1146 bytes} [Mon Nov 22 12:25:37 2021] POST /compute/v2.1/servers => generated 402 bytes in 1294 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 22 12:25:38.320736 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-45014077-ea72-4acb-8708-28305d213b01 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:25:38.323246 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-45014077-ea72-4acb-8708-28305d213b01 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: e5d549b4-7eb7-4cdd-90f0-ead23b7df090] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:25:38.447758 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-45014077-ea72-4acb-8708-28305d213b01 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41d885b9b854d8db11da5d325552301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f5dffe9bc3f41c7a2656d194fd02173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:25:38.464951 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-45014077-ea72-4acb-8708-28305d213b01 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "GET /compute/v2.1/servers/e5d549b4-7eb7-4cdd-90f0-ead23b7df090" status: 200 len: 1237 microversion: 2.1 time: 0.156467 Nov 22 12:25:38.466071 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 517/1099] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:25:38 2021] GET /compute/v2.1/servers/e5d549b4-7eb7-4cdd-90f0-ead23b7df090 => generated 1237 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:25:38.719185 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-30584b4f-73e6-4334-a037-f8391b054ea6 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:25:38.720391 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-30584b4f-73e6-4334-a037-f8391b054ea6 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: 496ce05f-ecc0-4dfd-b1d4-1c961f763af7] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:25:38.751547 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-30584b4f-73e6-4334-a037-f8391b054ea6 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:38.752826 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-30584b4f-73e6-4334-a037-f8391b054ea6 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:38.755194 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-30584b4f-73e6-4334-a037-f8391b054ea6 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:38.756348 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-30584b4f-73e6-4334-a037-f8391b054ea6 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:39.118401 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-30584b4f-73e6-4334-a037-f8391b054ea6 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:25:39.159194 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-30584b4f-73e6-4334-a037-f8391b054ea6 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:25:39.163876 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-30584b4f-73e6-4334-a037-f8391b054ea6 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:25:39.166617 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-30584b4f-73e6-4334-a037-f8391b054ea6 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "GET /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7" status: 200 len: 1737 microversion: 2.20 time: 0.454658 Nov 22 12:25:39.184430 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 583/1100] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Nov 22 12:25:38 2021] GET /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7 => generated 1737 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 22 12:25:39.486330 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-02ecfa6c-c09d-47ad-8def-9d531565ada7 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:25:39.487148 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-02ecfa6c-c09d-47ad-8def-9d531565ada7 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: e5d549b4-7eb7-4cdd-90f0-ead23b7df090] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:25:39.502199 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-02ecfa6c-c09d-47ad-8def-9d531565ada7 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:39.502655 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-02ecfa6c-c09d-47ad-8def-9d531565ada7 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:39.506751 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-02ecfa6c-c09d-47ad-8def-9d531565ada7 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:39.507833 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-02ecfa6c-c09d-47ad-8def-9d531565ada7 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:39.591048 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [req-df16211c-2bed-448e-8c6a-d5a906f6de73 req-61059729-df88-4bb6-84f9-2005bdecc24f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "496ce05f-ecc0-4dfd-b1d4-1c961f763af7", "name": "network-vif-plugged", "status": "completed", "tag": "94a1cac1-1361-4086-b60b-55660b9c75fc"}]} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:25:39.602187 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 12:25:39.602187 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: warnings.warn(msg) Nov 22 12:25:39.620368 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-02ecfa6c-c09d-47ad-8def-9d531565ada7 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41d885b9b854d8db11da5d325552301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f5dffe9bc3f41c7a2656d194fd02173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:25:39.627819 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [req-df16211c-2bed-448e-8c6a-d5a906f6de73 req-61059729-df88-4bb6-84f9-2005bdecc24f service nova] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:39.628943 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [req-df16211c-2bed-448e-8c6a-d5a906f6de73 req-61059729-df88-4bb6-84f9-2005bdecc24f service nova] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:39.669063 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-02ecfa6c-c09d-47ad-8def-9d531565ada7 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "GET /compute/v2.1/servers/e5d549b4-7eb7-4cdd-90f0-ead23b7df090" status: 200 len: 1289 microversion: 2.1 time: 0.188448 Nov 22 12:25:39.681163 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 518/1101] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:25:39 2021] GET /compute/v2.1/servers/e5d549b4-7eb7-4cdd-90f0-ead23b7df090 => generated 1289 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:25:39.689325 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.compute.server_external_events [req-df16211c-2bed-448e-8c6a-d5a906f6de73 req-61059729-df88-4bb6-84f9-2005bdecc24f service nova] Creating event network-vif-plugged:94a1cac1-1361-4086-b60b-55660b9c75fc for instance 496ce05f-ecc0-4dfd-b1d4-1c961f763af7 on hv-cinder-76845 Nov 22 12:25:39.701536 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [req-df16211c-2bed-448e-8c6a-d5a906f6de73 req-61059729-df88-4bb6-84f9-2005bdecc24f service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117624 Nov 22 12:25:39.705681 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 584/1102] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Nov 22 12:25:39 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 12:25:40.200128 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-4c7bd5e1-7b10-4a56-93a0-75e52eee5b26 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:25:40.201619 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-4c7bd5e1-7b10-4a56-93a0-75e52eee5b26 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: 496ce05f-ecc0-4dfd-b1d4-1c961f763af7] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:25:40.241255 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-4c7bd5e1-7b10-4a56-93a0-75e52eee5b26 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:40.244041 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-4c7bd5e1-7b10-4a56-93a0-75e52eee5b26 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:40.247213 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-4c7bd5e1-7b10-4a56-93a0-75e52eee5b26 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:40.250154 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-4c7bd5e1-7b10-4a56-93a0-75e52eee5b26 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:40.578650 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-4c7bd5e1-7b10-4a56-93a0-75e52eee5b26 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:25:40.592479 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-4c7bd5e1-7b10-4a56-93a0-75e52eee5b26 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:25:40.600869 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-4c7bd5e1-7b10-4a56-93a0-75e52eee5b26 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:25:40.602495 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-4c7bd5e1-7b10-4a56-93a0-75e52eee5b26 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "GET /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7" status: 200 len: 1737 microversion: 2.20 time: 0.410322 Nov 22 12:25:40.605756 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 519/1103] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Nov 22 12:25:40 2021] GET /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7 => generated 1737 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 12:25:40.720697 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-2ba720c4-2fff-4190-b462-3f9119698b0c tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:25:40.725566 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-2ba720c4-2fff-4190-b462-3f9119698b0c tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: e5d549b4-7eb7-4cdd-90f0-ead23b7df090] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:25:40.751897 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-2ba720c4-2fff-4190-b462-3f9119698b0c tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:40.752644 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-2ba720c4-2fff-4190-b462-3f9119698b0c tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:40.757402 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-2ba720c4-2fff-4190-b462-3f9119698b0c tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:40.760014 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-2ba720c4-2fff-4190-b462-3f9119698b0c tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:40.918638 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-2ba720c4-2fff-4190-b462-3f9119698b0c tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41d885b9b854d8db11da5d325552301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f5dffe9bc3f41c7a2656d194fd02173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:25:40.932744 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-2ba720c4-2fff-4190-b462-3f9119698b0c tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "GET /compute/v2.1/servers/e5d549b4-7eb7-4cdd-90f0-ead23b7df090" status: 200 len: 1295 microversion: 2.1 time: 0.227015 Nov 22 12:25:40.935063 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 585/1104] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:25:40 2021] GET /compute/v2.1/servers/e5d549b4-7eb7-4cdd-90f0-ead23b7df090 => generated 1295 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:25:41.625755 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-864268c7-80a3-4e0f-b392-32799dbd2ac9 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:25:41.631892 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-864268c7-80a3-4e0f-b392-32799dbd2ac9 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: 496ce05f-ecc0-4dfd-b1d4-1c961f763af7] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:25:41.639836 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-864268c7-80a3-4e0f-b392-32799dbd2ac9 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:41.640476 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-864268c7-80a3-4e0f-b392-32799dbd2ac9 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:41.643966 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-864268c7-80a3-4e0f-b392-32799dbd2ac9 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:41.645830 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-864268c7-80a3-4e0f-b392-32799dbd2ac9 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:41.952022 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-a0bd08f3-a6d7-4c5e-8fda-a6473fa4359d tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:25:41.952632 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-a0bd08f3-a6d7-4c5e-8fda-a6473fa4359d tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: e5d549b4-7eb7-4cdd-90f0-ead23b7df090] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:25:41.969329 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-a0bd08f3-a6d7-4c5e-8fda-a6473fa4359d tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:41.969969 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-a0bd08f3-a6d7-4c5e-8fda-a6473fa4359d tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:41.980467 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-a0bd08f3-a6d7-4c5e-8fda-a6473fa4359d tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:41.981185 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-a0bd08f3-a6d7-4c5e-8fda-a6473fa4359d tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:42.311357 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-864268c7-80a3-4e0f-b392-32799dbd2ac9 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:25:42.349602 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-a0bd08f3-a6d7-4c5e-8fda-a6473fa4359d tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41d885b9b854d8db11da5d325552301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f5dffe9bc3f41c7a2656d194fd02173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:25:42.361942 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-a0bd08f3-a6d7-4c5e-8fda-a6473fa4359d tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "GET /compute/v2.1/servers/e5d549b4-7eb7-4cdd-90f0-ead23b7df090" status: 200 len: 1363 microversion: 2.1 time: 0.413652 Nov 22 12:25:42.367298 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 586/1105] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:25:41 2021] GET /compute/v2.1/servers/e5d549b4-7eb7-4cdd-90f0-ead23b7df090 => generated 1363 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:25:42.405820 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-864268c7-80a3-4e0f-b392-32799dbd2ac9 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:25:42.417342 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-864268c7-80a3-4e0f-b392-32799dbd2ac9 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:25:42.421502 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-864268c7-80a3-4e0f-b392-32799dbd2ac9 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "GET /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7" status: 200 len: 1737 microversion: 2.20 time: 0.799602 Nov 22 12:25:42.428469 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 520/1106] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Nov 22 12:25:41 2021] GET /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7 => generated 1737 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 12:25:42.799152 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [req-c415be68-5dde-4206-8e04-37ad1c1396eb req-22de8c94-2daf-4d04-b30a-fb44d33390c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5d549b4-7eb7-4cdd-90f0-ead23b7df090", "tag": "cdf642d5-e9c9-4450-b020-77cb141c2767"}]} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:25:42.812862 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 12:25:42.812862 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: warnings.warn(msg) Nov 22 12:25:42.848872 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [req-c415be68-5dde-4206-8e04-37ad1c1396eb req-22de8c94-2daf-4d04-b30a-fb44d33390c7 service nova] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:42.854572 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [req-c415be68-5dde-4206-8e04-37ad1c1396eb req-22de8c94-2daf-4d04-b30a-fb44d33390c7 service nova] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:42.917994 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.compute.server_external_events [req-c415be68-5dde-4206-8e04-37ad1c1396eb req-22de8c94-2daf-4d04-b30a-fb44d33390c7 service nova] Creating event network-changed:cdf642d5-e9c9-4450-b020-77cb141c2767 for instance e5d549b4-7eb7-4cdd-90f0-ead23b7df090 on hv-cinder-76845 Nov 22 12:25:42.938525 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [req-c415be68-5dde-4206-8e04-37ad1c1396eb req-22de8c94-2daf-4d04-b30a-fb44d33390c7 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.143235 Nov 22 12:25:42.939980 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 587/1107] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Nov 22 12:25:42 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 12:25:43.383461 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-f150d956-f735-44b3-a2a2-2067bc31e688 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:25:43.384082 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-f150d956-f735-44b3-a2a2-2067bc31e688 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: e5d549b4-7eb7-4cdd-90f0-ead23b7df090] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:25:43.403373 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-f150d956-f735-44b3-a2a2-2067bc31e688 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:43.403832 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-f150d956-f735-44b3-a2a2-2067bc31e688 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:43.404649 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-f150d956-f735-44b3-a2a2-2067bc31e688 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:43.405088 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-f150d956-f735-44b3-a2a2-2067bc31e688 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:43.449761 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-f2bc42f4-47bf-4113-ae03-de8957605aac tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:25:43.450490 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-f2bc42f4-47bf-4113-ae03-de8957605aac tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: 496ce05f-ecc0-4dfd-b1d4-1c961f763af7] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:25:43.459063 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-f2bc42f4-47bf-4113-ae03-de8957605aac tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:43.472624 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-f2bc42f4-47bf-4113-ae03-de8957605aac tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:43.476604 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-f2bc42f4-47bf-4113-ae03-de8957605aac tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:43.477401 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-f2bc42f4-47bf-4113-ae03-de8957605aac tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:44.240706 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-f150d956-f735-44b3-a2a2-2067bc31e688 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41d885b9b854d8db11da5d325552301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f5dffe9bc3f41c7a2656d194fd02173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:25:44.256954 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-f2bc42f4-47bf-4113-ae03-de8957605aac tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:25:44.257571 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-f150d956-f735-44b3-a2a2-2067bc31e688 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "GET /compute/v2.1/servers/e5d549b4-7eb7-4cdd-90f0-ead23b7df090" status: 200 len: 1363 microversion: 2.1 time: 0.879313 Nov 22 12:25:44.258146 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 521/1108] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:25:43 2021] GET /compute/v2.1/servers/e5d549b4-7eb7-4cdd-90f0-ead23b7df090 => generated 1363 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:25:44.287150 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-f2bc42f4-47bf-4113-ae03-de8957605aac tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:25:44.289149 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-f2bc42f4-47bf-4113-ae03-de8957605aac tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:25:44.292520 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-f2bc42f4-47bf-4113-ae03-de8957605aac tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "GET /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7" status: 200 len: 1737 microversion: 2.20 time: 0.846727 Nov 22 12:25:44.294848 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 588/1109] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Nov 22 12:25:43 2021] GET /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7 => generated 1737 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 12:25:45.276708 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-4de43cb7-779c-4583-abe3-75951bdc9b57 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:25:45.278420 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-4de43cb7-779c-4583-abe3-75951bdc9b57 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: e5d549b4-7eb7-4cdd-90f0-ead23b7df090] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:25:45.285871 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-4de43cb7-779c-4583-abe3-75951bdc9b57 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:45.286339 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-4de43cb7-779c-4583-abe3-75951bdc9b57 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:45.287675 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-4de43cb7-779c-4583-abe3-75951bdc9b57 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:45.288423 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-4de43cb7-779c-4583-abe3-75951bdc9b57 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:45.312704 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-f1d81111-ffd7-4934-b8bf-dd5324f53f68 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:25:45.314255 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-f1d81111-ffd7-4934-b8bf-dd5324f53f68 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: 496ce05f-ecc0-4dfd-b1d4-1c961f763af7] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:25:45.325495 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-f1d81111-ffd7-4934-b8bf-dd5324f53f68 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:45.327799 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-f1d81111-ffd7-4934-b8bf-dd5324f53f68 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:45.332838 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-f1d81111-ffd7-4934-b8bf-dd5324f53f68 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:45.333726 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-f1d81111-ffd7-4934-b8bf-dd5324f53f68 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:45.649186 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-f1d81111-ffd7-4934-b8bf-dd5324f53f68 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:25:45.658324 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-4de43cb7-779c-4583-abe3-75951bdc9b57 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41d885b9b854d8db11da5d325552301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f5dffe9bc3f41c7a2656d194fd02173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:25:45.662028 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-f1d81111-ffd7-4934-b8bf-dd5324f53f68 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:25:45.663594 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-f1d81111-ffd7-4934-b8bf-dd5324f53f68 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:25:45.670953 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-4de43cb7-779c-4583-abe3-75951bdc9b57 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "GET /compute/v2.1/servers/e5d549b4-7eb7-4cdd-90f0-ead23b7df090" status: 200 len: 1363 microversion: 2.1 time: 0.398173 Nov 22 12:25:45.673591 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 522/1110] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:25:45 2021] GET /compute/v2.1/servers/e5d549b4-7eb7-4cdd-90f0-ead23b7df090 => generated 1363 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:25:45.675657 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-f1d81111-ffd7-4934-b8bf-dd5324f53f68 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "GET /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7" status: 200 len: 1737 microversion: 2.20 time: 0.366601 Nov 22 12:25:45.676904 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 589/1111] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Nov 22 12:25:45 2021] GET /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7 => generated 1737 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 12:25:46.694163 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-509eec9f-35b2-42d3-aff8-238a687dd318 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:25:46.698203 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-509eec9f-35b2-42d3-aff8-238a687dd318 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: 496ce05f-ecc0-4dfd-b1d4-1c961f763af7] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:25:46.698794 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-09fe5470-791e-4968-8fc9-dd0ea5c8b8bd tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:25:46.705695 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-09fe5470-791e-4968-8fc9-dd0ea5c8b8bd tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: e5d549b4-7eb7-4cdd-90f0-ead23b7df090] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:25:46.716519 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-09fe5470-791e-4968-8fc9-dd0ea5c8b8bd tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:46.720026 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-509eec9f-35b2-42d3-aff8-238a687dd318 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:46.721400 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-09fe5470-791e-4968-8fc9-dd0ea5c8b8bd tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:46.723145 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-09fe5470-791e-4968-8fc9-dd0ea5c8b8bd tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:46.724148 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-509eec9f-35b2-42d3-aff8-238a687dd318 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:46.726609 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-509eec9f-35b2-42d3-aff8-238a687dd318 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:46.727983 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-09fe5470-791e-4968-8fc9-dd0ea5c8b8bd tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:46.730381 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-509eec9f-35b2-42d3-aff8-238a687dd318 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:47.053088 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-09fe5470-791e-4968-8fc9-dd0ea5c8b8bd tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41d885b9b854d8db11da5d325552301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f5dffe9bc3f41c7a2656d194fd02173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:25:47.062600 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-09fe5470-791e-4968-8fc9-dd0ea5c8b8bd tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "GET /compute/v2.1/servers/e5d549b4-7eb7-4cdd-90f0-ead23b7df090" status: 200 len: 1363 microversion: 2.1 time: 0.376266 Nov 22 12:25:47.068523 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 523/1112] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:25:46 2021] GET /compute/v2.1/servers/e5d549b4-7eb7-4cdd-90f0-ead23b7df090 => generated 1363 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:25:47.086463 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-509eec9f-35b2-42d3-aff8-238a687dd318 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:25:47.105818 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-509eec9f-35b2-42d3-aff8-238a687dd318 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:25:47.120516 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-509eec9f-35b2-42d3-aff8-238a687dd318 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:25:47.124945 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-509eec9f-35b2-42d3-aff8-238a687dd318 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "GET /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7" status: 200 len: 1737 microversion: 2.20 time: 0.434761 Nov 22 12:25:47.140183 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 590/1113] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Nov 22 12:25:46 2021] GET /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7 => generated 1737 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 12:25:48.081875 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-475102fd-90a3-440a-9260-bfb585f6e84c tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:25:48.082525 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-475102fd-90a3-440a-9260-bfb585f6e84c tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: e5d549b4-7eb7-4cdd-90f0-ead23b7df090] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:25:48.101212 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-475102fd-90a3-440a-9260-bfb585f6e84c tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:48.101650 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-475102fd-90a3-440a-9260-bfb585f6e84c tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:48.108136 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-475102fd-90a3-440a-9260-bfb585f6e84c tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:48.108666 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-475102fd-90a3-440a-9260-bfb585f6e84c tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:48.148597 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-26f36812-cb27-4218-b88f-f3bd2fa93564 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:25:48.152692 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-26f36812-cb27-4218-b88f-f3bd2fa93564 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: 496ce05f-ecc0-4dfd-b1d4-1c961f763af7] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:25:48.162650 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-26f36812-cb27-4218-b88f-f3bd2fa93564 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:48.167304 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-26f36812-cb27-4218-b88f-f3bd2fa93564 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:48.168466 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-26f36812-cb27-4218-b88f-f3bd2fa93564 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:48.169072 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-26f36812-cb27-4218-b88f-f3bd2fa93564 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:48.378163 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-26f36812-cb27-4218-b88f-f3bd2fa93564 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:25:48.389729 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-26f36812-cb27-4218-b88f-f3bd2fa93564 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:25:48.391320 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-26f36812-cb27-4218-b88f-f3bd2fa93564 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:25:48.392827 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-26f36812-cb27-4218-b88f-f3bd2fa93564 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "GET /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7" status: 200 len: 1737 microversion: 2.20 time: 0.250460 Nov 22 12:25:48.393946 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 591/1114] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Nov 22 12:25:48 2021] GET /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7 => generated 1737 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 12:25:48.547411 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-475102fd-90a3-440a-9260-bfb585f6e84c tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41d885b9b854d8db11da5d325552301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f5dffe9bc3f41c7a2656d194fd02173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:25:48.559397 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-475102fd-90a3-440a-9260-bfb585f6e84c tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "GET /compute/v2.1/servers/e5d549b4-7eb7-4cdd-90f0-ead23b7df090" status: 200 len: 1363 microversion: 2.1 time: 0.481289 Nov 22 12:25:48.568472 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 524/1115] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:25:48 2021] GET /compute/v2.1/servers/e5d549b4-7eb7-4cdd-90f0-ead23b7df090 => generated 1363 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:25:49.414957 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-59f1ae5b-1a89-4023-bc2d-7a9ede62e5a3 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:25:49.415723 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-59f1ae5b-1a89-4023-bc2d-7a9ede62e5a3 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: 496ce05f-ecc0-4dfd-b1d4-1c961f763af7] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:25:49.428341 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-59f1ae5b-1a89-4023-bc2d-7a9ede62e5a3 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:49.434378 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-59f1ae5b-1a89-4023-bc2d-7a9ede62e5a3 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:49.435557 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-59f1ae5b-1a89-4023-bc2d-7a9ede62e5a3 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:49.436074 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-59f1ae5b-1a89-4023-bc2d-7a9ede62e5a3 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:49.507653 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [req-9948473f-8e76-4840-9f66-5a6c6c65656f req-ff65942b-992d-4e7a-b250-bfc7db24162d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5d549b4-7eb7-4cdd-90f0-ead23b7df090", "name": "network-vif-plugged", "status": "completed", "tag": "cdf642d5-e9c9-4450-b020-77cb141c2767"}]} {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:25:49.510013 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 12:25:49.510013 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: warnings.warn(msg) Nov 22 12:25:49.526189 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [req-9948473f-8e76-4840-9f66-5a6c6c65656f req-ff65942b-992d-4e7a-b250-bfc7db24162d service nova] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:49.526699 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [req-9948473f-8e76-4840-9f66-5a6c6c65656f req-ff65942b-992d-4e7a-b250-bfc7db24162d service nova] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:49.545886 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.compute.server_external_events [req-9948473f-8e76-4840-9f66-5a6c6c65656f req-ff65942b-992d-4e7a-b250-bfc7db24162d service nova] Creating event network-vif-plugged:cdf642d5-e9c9-4450-b020-77cb141c2767 for instance e5d549b4-7eb7-4cdd-90f0-ead23b7df090 on hv-cinder-76845 Nov 22 12:25:49.562837 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [req-9948473f-8e76-4840-9f66-5a6c6c65656f req-ff65942b-992d-4e7a-b250-bfc7db24162d service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058913 Nov 22 12:25:49.573140 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 525/1116] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Nov 22 12:25:49 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 22 12:25:49.581951 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-1ce92e2d-fc3c-467c-bf68-1fb9fe19850e tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:25:49.582937 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-1ce92e2d-fc3c-467c-bf68-1fb9fe19850e tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: e5d549b4-7eb7-4cdd-90f0-ead23b7df090] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:25:49.591052 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-1ce92e2d-fc3c-467c-bf68-1fb9fe19850e tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:49.591768 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-1ce92e2d-fc3c-467c-bf68-1fb9fe19850e tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:49.592743 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-1ce92e2d-fc3c-467c-bf68-1fb9fe19850e tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:49.593525 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-1ce92e2d-fc3c-467c-bf68-1fb9fe19850e tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:50.165404 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-59f1ae5b-1a89-4023-bc2d-7a9ede62e5a3 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:25:50.174778 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-59f1ae5b-1a89-4023-bc2d-7a9ede62e5a3 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:25:50.176344 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-59f1ae5b-1a89-4023-bc2d-7a9ede62e5a3 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:25:50.177548 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-59f1ae5b-1a89-4023-bc2d-7a9ede62e5a3 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "GET /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7" status: 200 len: 1737 microversion: 2.20 time: 0.768058 Nov 22 12:25:50.183277 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 592/1117] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Nov 22 12:25:49 2021] GET /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7 => generated 1737 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 12:25:50.238752 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-1ce92e2d-fc3c-467c-bf68-1fb9fe19850e tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41d885b9b854d8db11da5d325552301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f5dffe9bc3f41c7a2656d194fd02173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:25:50.249452 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-1ce92e2d-fc3c-467c-bf68-1fb9fe19850e tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "GET /compute/v2.1/servers/e5d549b4-7eb7-4cdd-90f0-ead23b7df090" status: 200 len: 1363 microversion: 2.1 time: 0.674620 Nov 22 12:25:50.250491 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 526/1118] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:25:49 2021] GET /compute/v2.1/servers/e5d549b4-7eb7-4cdd-90f0-ead23b7df090 => generated 1363 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:25:51.199569 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-4dc0d3ae-d44e-48d4-b07b-f5b5e10ac427 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:25:51.200878 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-4dc0d3ae-d44e-48d4-b07b-f5b5e10ac427 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: 496ce05f-ecc0-4dfd-b1d4-1c961f763af7] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:25:51.208707 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-4dc0d3ae-d44e-48d4-b07b-f5b5e10ac427 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:51.209273 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-4dc0d3ae-d44e-48d4-b07b-f5b5e10ac427 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:51.209961 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-4dc0d3ae-d44e-48d4-b07b-f5b5e10ac427 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:51.210396 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-4dc0d3ae-d44e-48d4-b07b-f5b5e10ac427 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:51.268079 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-92404e9b-cf7e-400f-b3d5-0e69778c2a4d tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:25:51.268674 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-92404e9b-cf7e-400f-b3d5-0e69778c2a4d tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: e5d549b4-7eb7-4cdd-90f0-ead23b7df090] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:25:51.275571 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-92404e9b-cf7e-400f-b3d5-0e69778c2a4d tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:51.276016 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-92404e9b-cf7e-400f-b3d5-0e69778c2a4d tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:51.276803 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-92404e9b-cf7e-400f-b3d5-0e69778c2a4d tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:51.277559 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-92404e9b-cf7e-400f-b3d5-0e69778c2a4d tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:51.520647 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-4dc0d3ae-d44e-48d4-b07b-f5b5e10ac427 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:25:51.526667 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-92404e9b-cf7e-400f-b3d5-0e69778c2a4d tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41d885b9b854d8db11da5d325552301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f5dffe9bc3f41c7a2656d194fd02173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:25:51.529637 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-4dc0d3ae-d44e-48d4-b07b-f5b5e10ac427 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:25:51.531362 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-4dc0d3ae-d44e-48d4-b07b-f5b5e10ac427 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:25:51.532857 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-4dc0d3ae-d44e-48d4-b07b-f5b5e10ac427 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "GET /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7" status: 200 len: 1719 microversion: 2.20 time: 0.338660 Nov 22 12:25:51.533403 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 593/1119] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Nov 22 12:25:51 2021] GET /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7 => generated 1719 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 12:25:51.535030 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-92404e9b-cf7e-400f-b3d5-0e69778c2a4d tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "GET /compute/v2.1/servers/e5d549b4-7eb7-4cdd-90f0-ead23b7df090" status: 200 len: 1363 microversion: 2.1 time: 0.270605 Nov 22 12:25:51.535621 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 527/1120] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:25:51 2021] GET /compute/v2.1/servers/e5d549b4-7eb7-4cdd-90f0-ead23b7df090 => generated 1363 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 12:25:52.554131 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-8dfae71f-0939-4596-a828-f735322fab3d tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:25:52.554812 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-8dfae71f-0939-4596-a828-f735322fab3d tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: 496ce05f-ecc0-4dfd-b1d4-1c961f763af7] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:25:52.557430 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-498c11a5-17d1-4f21-8566-799a8c76c5ff tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:25:52.558035 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-498c11a5-17d1-4f21-8566-799a8c76c5ff tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: e5d549b4-7eb7-4cdd-90f0-ead23b7df090] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:25:52.561710 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-8dfae71f-0939-4596-a828-f735322fab3d tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:52.562414 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-8dfae71f-0939-4596-a828-f735322fab3d tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:52.563545 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-8dfae71f-0939-4596-a828-f735322fab3d tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:52.564158 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-8dfae71f-0939-4596-a828-f735322fab3d tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:52.565176 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-498c11a5-17d1-4f21-8566-799a8c76c5ff tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:52.565626 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-498c11a5-17d1-4f21-8566-799a8c76c5ff tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:52.566473 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-498c11a5-17d1-4f21-8566-799a8c76c5ff tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:52.566906 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-498c11a5-17d1-4f21-8566-799a8c76c5ff tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:52.764014 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-498c11a5-17d1-4f21-8566-799a8c76c5ff tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41d885b9b854d8db11da5d325552301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f5dffe9bc3f41c7a2656d194fd02173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:25:52.770994 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-8dfae71f-0939-4596-a828-f735322fab3d tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:25:52.772419 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-498c11a5-17d1-4f21-8566-799a8c76c5ff tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "GET /compute/v2.1/servers/e5d549b4-7eb7-4cdd-90f0-ead23b7df090" status: 200 len: 1548 microversion: 2.1 time: 0.219599 Nov 22 12:25:52.772990 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 528/1121] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:25:52 2021] GET /compute/v2.1/servers/e5d549b4-7eb7-4cdd-90f0-ead23b7df090 => generated 1548 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:25:52.779558 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-8dfae71f-0939-4596-a828-f735322fab3d tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:25:52.781149 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-8dfae71f-0939-4596-a828-f735322fab3d tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:25:52.782297 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-8dfae71f-0939-4596-a828-f735322fab3d tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "GET /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7" status: 200 len: 1719 microversion: 2.20 time: 0.233930 Nov 22 12:25:52.782842 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 594/1122] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Nov 22 12:25:52 2021] GET /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7 => generated 1719 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 22 12:25:52.788628 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-6b2c2598-641a-4a44-8391-a8a884b087ad tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:25:52.789137 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-6b2c2598-641a-4a44-8391-a8a884b087ad tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: e5d549b4-7eb7-4cdd-90f0-ead23b7df090] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:25:52.794961 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-6b2c2598-641a-4a44-8391-a8a884b087ad tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:52.795438 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-6b2c2598-641a-4a44-8391-a8a884b087ad tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:52.796199 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-6b2c2598-641a-4a44-8391-a8a884b087ad tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:52.796689 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-6b2c2598-641a-4a44-8391-a8a884b087ad tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:52.886858 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-6b2c2598-641a-4a44-8391-a8a884b087ad tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "GET /compute/v2.1/servers/e5d549b4-7eb7-4cdd-90f0-ead23b7df090/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.101677 Nov 22 12:25:52.887507 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 529/1123] 10.222.0.66 () {58 vars in 1274 bytes} [Mon Nov 22 12:25:52 2021] GET /compute/v2.1/servers/e5d549b4-7eb7-4cdd-90f0-ead23b7df090/os-interface => generated 284 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 12:25:53.801328 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-cc3d61c4-4156-424d-81ff-5e3bf5204cf2 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:25:53.802933 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-cc3d61c4-4156-424d-81ff-5e3bf5204cf2 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: 496ce05f-ecc0-4dfd-b1d4-1c961f763af7] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:25:53.810401 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-cc3d61c4-4156-424d-81ff-5e3bf5204cf2 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:53.810906 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-cc3d61c4-4156-424d-81ff-5e3bf5204cf2 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:53.812021 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-cc3d61c4-4156-424d-81ff-5e3bf5204cf2 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:53.812674 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-cc3d61c4-4156-424d-81ff-5e3bf5204cf2 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:53.887718 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-3807e674-04cd-40dd-9a6f-92b087644fd3 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:25:53.889373 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-3807e674-04cd-40dd-9a6f-92b087644fd3 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: e5d549b4-7eb7-4cdd-90f0-ead23b7df090] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:25:53.896135 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-3807e674-04cd-40dd-9a6f-92b087644fd3 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:53.896696 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-3807e674-04cd-40dd-9a6f-92b087644fd3 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:53.897570 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-3807e674-04cd-40dd-9a6f-92b087644fd3 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:53.898143 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-3807e674-04cd-40dd-9a6f-92b087644fd3 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:53.961091 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-3807e674-04cd-40dd-9a6f-92b087644fd3 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "POST /compute/v2.1/servers/e5d549b4-7eb7-4cdd-90f0-ead23b7df090/action" status: 200 len: 14 microversion: 2.1 time: 0.077965 Nov 22 12:25:53.961623 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 530/1124] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Nov 22 12:25:53 2021] POST /compute/v2.1/servers/e5d549b4-7eb7-4cdd-90f0-ead23b7df090/action => generated 14 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 22 12:25:53.963921 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-cc3d61c4-4156-424d-81ff-5e3bf5204cf2 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:25:53.967881 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [req-2886ef9b-a4b1-41d6-b273-30d3fd6d24a5 req-c824b628-2ab8-4cf3-82e1-db868a755ab1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5d549b4-7eb7-4cdd-90f0-ead23b7df090", "tag": "cdf642d5-e9c9-4450-b020-77cb141c2767"}]} {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:25:53.970049 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 12:25:53.970049 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: warnings.warn(msg) Nov 22 12:25:53.973125 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-cc3d61c4-4156-424d-81ff-5e3bf5204cf2 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:25:53.974732 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-cc3d61c4-4156-424d-81ff-5e3bf5204cf2 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:25:53.976055 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-cc3d61c4-4156-424d-81ff-5e3bf5204cf2 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "GET /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7" status: 200 len: 1722 microversion: 2.20 time: 0.179085 Nov 22 12:25:53.976699 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 595/1125] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Nov 22 12:25:53 2021] GET /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7 => generated 1722 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 12:25:53.978515 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [req-2886ef9b-a4b1-41d6-b273-30d3fd6d24a5 req-c824b628-2ab8-4cf3-82e1-db868a755ab1 service nova] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:53.978968 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [req-2886ef9b-a4b1-41d6-b273-30d3fd6d24a5 req-c824b628-2ab8-4cf3-82e1-db868a755ab1 service nova] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:53.991102 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.compute.server_external_events [req-2886ef9b-a4b1-41d6-b273-30d3fd6d24a5 req-c824b628-2ab8-4cf3-82e1-db868a755ab1 service nova] Creating event network-changed:cdf642d5-e9c9-4450-b020-77cb141c2767 for instance e5d549b4-7eb7-4cdd-90f0-ead23b7df090 on hv-cinder-76845 Nov 22 12:25:53.996239 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [req-2886ef9b-a4b1-41d6-b273-30d3fd6d24a5 req-c824b628-2ab8-4cf3-82e1-db868a755ab1 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033016 Nov 22 12:25:53.996455 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-a35636fe-e69a-4b42-9b74-9ad75c92967b tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f4c6caa7-b6e3-405e-a527-7916c19dc92b"}} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:25:53.997371 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 531/1126] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Nov 22 12:25:53 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 12:25:53.997649 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-a35636fe-e69a-4b42-9b74-9ad75c92967b tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: 496ce05f-ecc0-4dfd-b1d4-1c961f763af7] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:25:54.004743 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-a35636fe-e69a-4b42-9b74-9ad75c92967b tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:54.005272 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-a35636fe-e69a-4b42-9b74-9ad75c92967b tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:54.006165 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-a35636fe-e69a-4b42-9b74-9ad75c92967b tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:54.006699 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-a35636fe-e69a-4b42-9b74-9ad75c92967b tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:54.294794 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-a35636fe-e69a-4b42-9b74-9ad75c92967b tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "POST /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.302564 Nov 22 12:25:54.296017 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 596/1127] 10.222.0.66 () {62 vars in 1363 bytes} [Mon Nov 22 12:25:53 2021] POST /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7/os-volume_attachments => generated 188 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 12:25:54.414219 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-a30f6395-ab10-4afd-9f96-cf0938f736e2 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:25:54.414766 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-a30f6395-ab10-4afd-9f96-cf0938f736e2 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: 496ce05f-ecc0-4dfd-b1d4-1c961f763af7] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:25:54.420898 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-a30f6395-ab10-4afd-9f96-cf0938f736e2 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:54.421340 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-a30f6395-ab10-4afd-9f96-cf0938f736e2 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:54.422311 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-a30f6395-ab10-4afd-9f96-cf0938f736e2 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:54.422729 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-a30f6395-ab10-4afd-9f96-cf0938f736e2 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:54.738765 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-a30f6395-ab10-4afd-9f96-cf0938f736e2 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "DELETE /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7/os-volume_attachments/f4c6caa7-b6e3-405e-a527-7916c19dc92b" status: 202 len: 0 microversion: 2.20 time: 0.329060 Nov 22 12:25:54.739925 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 532/1128] 10.222.0.66 () {60 vars in 1456 bytes} [Mon Nov 22 12:25:54 2021] DELETE /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7/os-volume_attachments/f4c6caa7-b6e3-405e-a527-7916c19dc92b => generated 0 bytes in 332 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Nov 22 12:25:54.801681 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-3a527eb5-3b76-4902-acc6-e65c5ae42f03 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:25:54.802352 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-3a527eb5-3b76-4902-acc6-e65c5ae42f03 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: 496ce05f-ecc0-4dfd-b1d4-1c961f763af7] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:25:54.809577 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-3a527eb5-3b76-4902-acc6-e65c5ae42f03 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:54.810047 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-3a527eb5-3b76-4902-acc6-e65c5ae42f03 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:54.810840 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-3a527eb5-3b76-4902-acc6-e65c5ae42f03 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:54.811373 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-3a527eb5-3b76-4902-acc6-e65c5ae42f03 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:54.899280 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-3a527eb5-3b76-4902-acc6-e65c5ae42f03 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "POST /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7/action" status: 202 len: 0 microversion: 2.20 time: 0.101504 Nov 22 12:25:54.900132 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 597/1129] 10.222.0.66 () {62 vars in 1318 bytes} [Mon Nov 22 12:25:54 2021] POST /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7/action => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 22 12:25:54.909447 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-7d8ce1e1-e96c-4962-82d8-999e17dd8222 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:25:54.910120 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-7d8ce1e1-e96c-4962-82d8-999e17dd8222 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: 496ce05f-ecc0-4dfd-b1d4-1c961f763af7] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:25:54.917278 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-7d8ce1e1-e96c-4962-82d8-999e17dd8222 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:54.917726 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-7d8ce1e1-e96c-4962-82d8-999e17dd8222 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:54.918526 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-7d8ce1e1-e96c-4962-82d8-999e17dd8222 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:54.919124 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-7d8ce1e1-e96c-4962-82d8-999e17dd8222 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:54.977043 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-b7ace751-4afb-446c-b259-d086251c607b tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:25:54.978442 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-b7ace751-4afb-446c-b259-d086251c607b tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: e5d549b4-7eb7-4cdd-90f0-ead23b7df090] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:25:54.986778 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-b7ace751-4afb-446c-b259-d086251c607b tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:54.987760 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-b7ace751-4afb-446c-b259-d086251c607b tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:54.989206 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-b7ace751-4afb-446c-b259-d086251c607b tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:54.989721 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-b7ace751-4afb-446c-b259-d086251c607b tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:55.056865 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-b7ace751-4afb-446c-b259-d086251c607b tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "POST /compute/v2.1/servers/e5d549b4-7eb7-4cdd-90f0-ead23b7df090/action" status: 200 len: 14 microversion: 2.1 time: 0.083910 Nov 22 12:25:55.057536 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 598/1130] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Nov 22 12:25:54 2021] POST /compute/v2.1/servers/e5d549b4-7eb7-4cdd-90f0-ead23b7df090/action => generated 14 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 22 12:25:55.092142 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-7d8ce1e1-e96c-4962-82d8-999e17dd8222 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:25:55.102551 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-7d8ce1e1-e96c-4962-82d8-999e17dd8222 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:25:55.104113 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-7d8ce1e1-e96c-4962-82d8-999e17dd8222 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:25:55.105429 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-7d8ce1e1-e96c-4962-82d8-999e17dd8222 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "GET /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7" status: 200 len: 1670 microversion: 2.20 time: 0.200903 Nov 22 12:25:55.106133 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 533/1131] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Nov 22 12:25:54 2021] GET /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7 => generated 1670 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 12:25:55.436379 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [req-6db59770-6987-4598-b807-d798ab2257e7 req-83c1c353-d033-4bf2-9e35-8abf4ca836d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "496ce05f-ecc0-4dfd-b1d4-1c961f763af7", "name": "network-vif-unplugged", "status": "completed", "tag": "94a1cac1-1361-4086-b60b-55660b9c75fc"}]} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:25:55.438984 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 12:25:55.438984 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: warnings.warn(msg) Nov 22 12:25:55.450216 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [req-6db59770-6987-4598-b807-d798ab2257e7 req-83c1c353-d033-4bf2-9e35-8abf4ca836d4 service nova] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:55.450767 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [req-6db59770-6987-4598-b807-d798ab2257e7 req-83c1c353-d033-4bf2-9e35-8abf4ca836d4 service nova] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:55.464077 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.compute.server_external_events [req-6db59770-6987-4598-b807-d798ab2257e7 req-83c1c353-d033-4bf2-9e35-8abf4ca836d4 service nova] Unable to find a host for instance 496ce05f-ecc0-4dfd-b1d4-1c961f763af7. Dropping event network-vif-unplugged {{(pid=116272) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Nov 22 12:25:55.465060 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [req-6db59770-6987-4598-b807-d798ab2257e7 req-83c1c353-d033-4bf2-9e35-8abf4ca836d4 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.034151 Nov 22 12:25:55.465752 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 599/1132] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Nov 22 12:25:55 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 36 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Nov 22 12:25:56.068714 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-1b0904e0-8aa7-48fa-a95d-4b7da10f8a56 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:25:56.069691 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-1b0904e0-8aa7-48fa-a95d-4b7da10f8a56 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: e5d549b4-7eb7-4cdd-90f0-ead23b7df090] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:25:56.076641 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-1b0904e0-8aa7-48fa-a95d-4b7da10f8a56 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:56.077093 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-1b0904e0-8aa7-48fa-a95d-4b7da10f8a56 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:56.078117 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-1b0904e0-8aa7-48fa-a95d-4b7da10f8a56 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:56.078435 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-1b0904e0-8aa7-48fa-a95d-4b7da10f8a56 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:56.124785 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-e0322d11-0480-4fb4-9c66-148d06ae8df2 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:25:56.125514 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-e0322d11-0480-4fb4-9c66-148d06ae8df2 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: 496ce05f-ecc0-4dfd-b1d4-1c961f763af7] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:25:56.132424 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-e0322d11-0480-4fb4-9c66-148d06ae8df2 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:56.132695 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-e0322d11-0480-4fb4-9c66-148d06ae8df2 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:56.133514 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-e0322d11-0480-4fb4-9c66-148d06ae8df2 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:56.133948 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-e0322d11-0480-4fb4-9c66-148d06ae8df2 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:56.146661 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-1b0904e0-8aa7-48fa-a95d-4b7da10f8a56 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "POST /compute/v2.1/servers/e5d549b4-7eb7-4cdd-90f0-ead23b7df090/action" status: 200 len: 14 microversion: 2.1 time: 0.081197 Nov 22 12:25:56.150812 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 534/1133] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Nov 22 12:25:56 2021] POST /compute/v2.1/servers/e5d549b4-7eb7-4cdd-90f0-ead23b7df090/action => generated 14 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 22 12:25:56.375302 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-e0322d11-0480-4fb4-9c66-148d06ae8df2 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:25:56.385237 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-e0322d11-0480-4fb4-9c66-148d06ae8df2 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:25:56.387218 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-e0322d11-0480-4fb4-9c66-148d06ae8df2 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:25:56.388660 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-e0322d11-0480-4fb4-9c66-148d06ae8df2 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "GET /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7" status: 200 len: 1728 microversion: 2.20 time: 0.267601 Nov 22 12:25:56.389205 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 600/1134] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Nov 22 12:25:56 2021] GET /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7 => generated 1728 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 12:25:57.159102 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-d76e37f2-2866-4a84-b5e6-dd89350751bb tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:25:57.160133 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-d76e37f2-2866-4a84-b5e6-dd89350751bb tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: e5d549b4-7eb7-4cdd-90f0-ead23b7df090] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:25:57.167413 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-d76e37f2-2866-4a84-b5e6-dd89350751bb tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:57.167859 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-d76e37f2-2866-4a84-b5e6-dd89350751bb tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:57.168648 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-d76e37f2-2866-4a84-b5e6-dd89350751bb tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:57.169075 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-d76e37f2-2866-4a84-b5e6-dd89350751bb tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:57.239947 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-d76e37f2-2866-4a84-b5e6-dd89350751bb tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "POST /compute/v2.1/servers/e5d549b4-7eb7-4cdd-90f0-ead23b7df090/action" status: 200 len: 14 microversion: 2.1 time: 0.084682 Nov 22 12:25:57.241010 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 535/1135] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Nov 22 12:25:57 2021] POST /compute/v2.1/servers/e5d549b4-7eb7-4cdd-90f0-ead23b7df090/action => generated 14 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 22 12:25:57.410652 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-1833b8a3-ba33-4ef0-a959-05431d8deac8 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:25:57.413388 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-1833b8a3-ba33-4ef0-a959-05431d8deac8 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: 496ce05f-ecc0-4dfd-b1d4-1c961f763af7] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:25:57.421586 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-1833b8a3-ba33-4ef0-a959-05431d8deac8 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:57.422638 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-1833b8a3-ba33-4ef0-a959-05431d8deac8 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:57.423668 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-1833b8a3-ba33-4ef0-a959-05431d8deac8 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:57.424397 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-1833b8a3-ba33-4ef0-a959-05431d8deac8 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:57.586916 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-1833b8a3-ba33-4ef0-a959-05431d8deac8 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:25:57.599949 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-1833b8a3-ba33-4ef0-a959-05431d8deac8 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:25:57.602726 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-1833b8a3-ba33-4ef0-a959-05431d8deac8 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:25:57.604945 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-1833b8a3-ba33-4ef0-a959-05431d8deac8 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "GET /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7" status: 200 len: 1728 microversion: 2.20 time: 0.198897 Nov 22 12:25:57.605866 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 601/1136] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Nov 22 12:25:57 2021] GET /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7 => generated 1728 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 12:25:58.254927 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-7e112bea-dcd4-4b53-9d09-0b8ace803fdb tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:25:58.256002 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-7e112bea-dcd4-4b53-9d09-0b8ace803fdb tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: e5d549b4-7eb7-4cdd-90f0-ead23b7df090] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:25:58.263331 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-7e112bea-dcd4-4b53-9d09-0b8ace803fdb tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:58.263782 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-7e112bea-dcd4-4b53-9d09-0b8ace803fdb tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:58.264578 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-7e112bea-dcd4-4b53-9d09-0b8ace803fdb tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:58.265008 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-7e112bea-dcd4-4b53-9d09-0b8ace803fdb tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:58.627036 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-80d5081e-23c8-4fb3-9b9d-03f691b50cbf tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:25:58.627665 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-80d5081e-23c8-4fb3-9b9d-03f691b50cbf tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: 496ce05f-ecc0-4dfd-b1d4-1c961f763af7] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:25:58.635161 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-80d5081e-23c8-4fb3-9b9d-03f691b50cbf tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:58.635889 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-80d5081e-23c8-4fb3-9b9d-03f691b50cbf tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:58.636787 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-80d5081e-23c8-4fb3-9b9d-03f691b50cbf tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:58.637284 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-80d5081e-23c8-4fb3-9b9d-03f691b50cbf tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:58.785545 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-80d5081e-23c8-4fb3-9b9d-03f691b50cbf tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:25:58.793659 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-80d5081e-23c8-4fb3-9b9d-03f691b50cbf tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:25:58.795185 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-80d5081e-23c8-4fb3-9b9d-03f691b50cbf tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:25:58.796377 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-80d5081e-23c8-4fb3-9b9d-03f691b50cbf tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "GET /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7" status: 200 len: 1728 microversion: 2.20 time: 0.175449 Nov 22 12:25:58.803423 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 602/1137] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Nov 22 12:25:58 2021] GET /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7 => generated 1728 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 12:25:59.815810 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-f8b46d22-65d3-4959-9fc3-2a196ea415b9 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:25:59.816466 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-f8b46d22-65d3-4959-9fc3-2a196ea415b9 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: 496ce05f-ecc0-4dfd-b1d4-1c961f763af7] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:25:59.823532 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-f8b46d22-65d3-4959-9fc3-2a196ea415b9 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:59.824070 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-f8b46d22-65d3-4959-9fc3-2a196ea415b9 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:59.825175 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-f8b46d22-65d3-4959-9fc3-2a196ea415b9 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:25:59.825677 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-f8b46d22-65d3-4959-9fc3-2a196ea415b9 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:25:59.970511 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-f8b46d22-65d3-4959-9fc3-2a196ea415b9 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:25:59.978974 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-f8b46d22-65d3-4959-9fc3-2a196ea415b9 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:25:59.980517 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-f8b46d22-65d3-4959-9fc3-2a196ea415b9 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:25:59.981675 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-f8b46d22-65d3-4959-9fc3-2a196ea415b9 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "GET /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7" status: 200 len: 1728 microversion: 2.20 time: 0.170065 Nov 22 12:25:59.982234 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 603/1138] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Nov 22 12:25:59 2021] GET /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7 => generated 1728 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 22 12:26:01.000623 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-08914703-8d54-476c-9263-cbeb1d8a9287 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:26:01.001349 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-08914703-8d54-476c-9263-cbeb1d8a9287 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: 496ce05f-ecc0-4dfd-b1d4-1c961f763af7] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:26:01.008179 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-08914703-8d54-476c-9263-cbeb1d8a9287 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:26:01.009007 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-08914703-8d54-476c-9263-cbeb1d8a9287 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:26:01.009861 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-08914703-8d54-476c-9263-cbeb1d8a9287 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:26:01.010315 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-08914703-8d54-476c-9263-cbeb1d8a9287 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:26:01.171643 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-08914703-8d54-476c-9263-cbeb1d8a9287 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:26:01.180295 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-08914703-8d54-476c-9263-cbeb1d8a9287 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:26:01.181743 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-08914703-8d54-476c-9263-cbeb1d8a9287 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:26:01.182942 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-08914703-8d54-476c-9263-cbeb1d8a9287 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "GET /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7" status: 200 len: 1728 microversion: 2.20 time: 0.186200 Nov 22 12:26:01.183523 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 604/1139] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Nov 22 12:26:00 2021] GET /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7 => generated 1728 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 12:26:02.205808 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-8c9ddb34-4db7-4d16-bd4e-f48b93211ac8 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:26:02.206862 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-8c9ddb34-4db7-4d16-bd4e-f48b93211ac8 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: 496ce05f-ecc0-4dfd-b1d4-1c961f763af7] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:26:02.217197 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-8c9ddb34-4db7-4d16-bd4e-f48b93211ac8 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:26:02.217922 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-8c9ddb34-4db7-4d16-bd4e-f48b93211ac8 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:26:02.219307 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-8c9ddb34-4db7-4d16-bd4e-f48b93211ac8 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:26:02.220047 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-8c9ddb34-4db7-4d16-bd4e-f48b93211ac8 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:26:02.378255 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-8c9ddb34-4db7-4d16-bd4e-f48b93211ac8 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:26:02.386790 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-8c9ddb34-4db7-4d16-bd4e-f48b93211ac8 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:26:02.388646 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-8c9ddb34-4db7-4d16-bd4e-f48b93211ac8 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:26:02.389921 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-8c9ddb34-4db7-4d16-bd4e-f48b93211ac8 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "GET /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7" status: 200 len: 1728 microversion: 2.20 time: 0.190369 Nov 22 12:26:02.390646 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 605/1140] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Nov 22 12:26:02 2021] GET /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7 => generated 1728 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 22 12:26:03.410605 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-a3724d1c-1eb4-4d89-9746-7d99a87698b0 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:26:03.411420 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-a3724d1c-1eb4-4d89-9746-7d99a87698b0 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: 496ce05f-ecc0-4dfd-b1d4-1c961f763af7] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:26:03.418435 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-a3724d1c-1eb4-4d89-9746-7d99a87698b0 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:26:03.418884 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-a3724d1c-1eb4-4d89-9746-7d99a87698b0 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:26:03.419789 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-a3724d1c-1eb4-4d89-9746-7d99a87698b0 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:26:03.420252 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-a3724d1c-1eb4-4d89-9746-7d99a87698b0 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:26:03.583506 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-a3724d1c-1eb4-4d89-9746-7d99a87698b0 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:26:03.591826 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-a3724d1c-1eb4-4d89-9746-7d99a87698b0 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:26:03.593327 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-a3724d1c-1eb4-4d89-9746-7d99a87698b0 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:26:03.595097 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-a3724d1c-1eb4-4d89-9746-7d99a87698b0 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "GET /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7" status: 200 len: 1728 microversion: 2.20 time: 0.189551 Nov 22 12:26:03.595748 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 606/1141] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Nov 22 12:26:03 2021] GET /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7 => generated 1728 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 12:26:04.614760 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-c370782f-4464-4b1d-b071-fde722617093 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:26:04.615483 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-c370782f-4464-4b1d-b071-fde722617093 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: 496ce05f-ecc0-4dfd-b1d4-1c961f763af7] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:26:04.621963 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-c370782f-4464-4b1d-b071-fde722617093 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:26:04.622419 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-c370782f-4464-4b1d-b071-fde722617093 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:26:04.623215 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-c370782f-4464-4b1d-b071-fde722617093 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:26:04.623803 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-c370782f-4464-4b1d-b071-fde722617093 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:26:04.782514 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-c370782f-4464-4b1d-b071-fde722617093 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:26:04.791119 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-c370782f-4464-4b1d-b071-fde722617093 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:26:04.792692 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-c370782f-4464-4b1d-b071-fde722617093 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:26:04.793857 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-c370782f-4464-4b1d-b071-fde722617093 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "GET /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7" status: 200 len: 1728 microversion: 2.20 time: 0.183249 Nov 22 12:26:04.794403 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 607/1142] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Nov 22 12:26:04 2021] GET /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7 => generated 1728 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 12:26:05.811720 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-ac2900ce-0565-45a0-b9d0-407a597a47b8 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:26:05.812380 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-ac2900ce-0565-45a0-b9d0-407a597a47b8 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: 496ce05f-ecc0-4dfd-b1d4-1c961f763af7] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:26:05.819307 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-ac2900ce-0565-45a0-b9d0-407a597a47b8 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:26:05.819835 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-ac2900ce-0565-45a0-b9d0-407a597a47b8 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:26:05.820808 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-ac2900ce-0565-45a0-b9d0-407a597a47b8 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:26:05.821191 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-ac2900ce-0565-45a0-b9d0-407a597a47b8 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:26:05.963597 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-ac2900ce-0565-45a0-b9d0-407a597a47b8 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:26:05.971686 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-ac2900ce-0565-45a0-b9d0-407a597a47b8 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:26:05.973164 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-ac2900ce-0565-45a0-b9d0-407a597a47b8 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:26:05.974342 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-ac2900ce-0565-45a0-b9d0-407a597a47b8 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "GET /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7" status: 200 len: 1728 microversion: 2.20 time: 0.166584 Nov 22 12:26:05.974902 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 608/1143] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Nov 22 12:26:05 2021] GET /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7 => generated 1728 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 12:26:06.994148 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-fda3b21c-afd7-4414-90b7-7647bea9ac49 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:26:06.994926 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-fda3b21c-afd7-4414-90b7-7647bea9ac49 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: 496ce05f-ecc0-4dfd-b1d4-1c961f763af7] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:26:07.004226 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-fda3b21c-afd7-4414-90b7-7647bea9ac49 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:26:07.004689 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-fda3b21c-afd7-4414-90b7-7647bea9ac49 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:26:07.005474 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-fda3b21c-afd7-4414-90b7-7647bea9ac49 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:26:07.005913 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-fda3b21c-afd7-4414-90b7-7647bea9ac49 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:26:07.171193 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-fda3b21c-afd7-4414-90b7-7647bea9ac49 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:26:07.181077 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-fda3b21c-afd7-4414-90b7-7647bea9ac49 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:26:07.182867 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-fda3b21c-afd7-4414-90b7-7647bea9ac49 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:26:07.184099 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-fda3b21c-afd7-4414-90b7-7647bea9ac49 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "GET /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7" status: 200 len: 1728 microversion: 2.20 time: 0.194585 Nov 22 12:26:07.184659 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 609/1144] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Nov 22 12:26:06 2021] GET /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7 => generated 1728 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 22 12:26:08.202777 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-9927f0e2-2e52-4028-897e-4ca9e69f8ddc tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:26:08.203504 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-9927f0e2-2e52-4028-897e-4ca9e69f8ddc tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: 496ce05f-ecc0-4dfd-b1d4-1c961f763af7] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:26:08.210481 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-9927f0e2-2e52-4028-897e-4ca9e69f8ddc tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:26:08.210929 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-9927f0e2-2e52-4028-897e-4ca9e69f8ddc tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:26:08.211739 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-9927f0e2-2e52-4028-897e-4ca9e69f8ddc tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:26:08.212164 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-9927f0e2-2e52-4028-897e-4ca9e69f8ddc tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:26:08.353088 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-9927f0e2-2e52-4028-897e-4ca9e69f8ddc tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:26:08.364982 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-9927f0e2-2e52-4028-897e-4ca9e69f8ddc tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:26:08.366492 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-9927f0e2-2e52-4028-897e-4ca9e69f8ddc tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:26:08.367706 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-9927f0e2-2e52-4028-897e-4ca9e69f8ddc tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "GET /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7" status: 200 len: 1728 microversion: 2.20 time: 0.168827 Nov 22 12:26:08.368305 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 610/1145] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Nov 22 12:26:08 2021] GET /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7 => generated 1728 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 12:26:09.386673 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-583d8ccf-4193-46a8-ab53-7c6cc4a027c7 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:26:09.387374 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-583d8ccf-4193-46a8-ab53-7c6cc4a027c7 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: 496ce05f-ecc0-4dfd-b1d4-1c961f763af7] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:26:09.394091 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-583d8ccf-4193-46a8-ab53-7c6cc4a027c7 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:26:09.394543 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-583d8ccf-4193-46a8-ab53-7c6cc4a027c7 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:26:09.395360 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-583d8ccf-4193-46a8-ab53-7c6cc4a027c7 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:26:09.395805 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-583d8ccf-4193-46a8-ab53-7c6cc4a027c7 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:26:09.542915 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-7e112bea-dcd4-4b53-9d09-0b8ace803fdb tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "POST /compute/v2.1/servers/e5d549b4-7eb7-4cdd-90f0-ead23b7df090/action" status: 200 len: 22168 microversion: 2.1 time: 11.291932 Nov 22 12:26:09.544109 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 536/1146] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Nov 22 12:25:58 2021] POST /compute/v2.1/servers/e5d549b4-7eb7-4cdd-90f0-ead23b7df090/action => generated 22168 bytes in 11294 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 12:26:09.546008 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-583d8ccf-4193-46a8-ab53-7c6cc4a027c7 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:26:09.559483 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-583d8ccf-4193-46a8-ab53-7c6cc4a027c7 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:26:09.561907 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-583d8ccf-4193-46a8-ab53-7c6cc4a027c7 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:26:09.563826 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-583d8ccf-4193-46a8-ab53-7c6cc4a027c7 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "GET /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7" status: 200 len: 1728 microversion: 2.20 time: 0.180818 Nov 22 12:26:09.564649 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 611/1147] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Nov 22 12:26:09 2021] GET /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7 => generated 1728 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 12:26:10.557128 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-69b88e19-3ba1-4df8-8750-ff631c49f7df tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:26:10.558382 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-69b88e19-3ba1-4df8-8750-ff631c49f7df tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: e5d549b4-7eb7-4cdd-90f0-ead23b7df090] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:26:10.566239 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-69b88e19-3ba1-4df8-8750-ff631c49f7df tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:26:10.566689 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-69b88e19-3ba1-4df8-8750-ff631c49f7df tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:26:10.567621 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-69b88e19-3ba1-4df8-8750-ff631c49f7df tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:26:10.568095 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-69b88e19-3ba1-4df8-8750-ff631c49f7df tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:26:10.585257 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-f2dbebac-6ce1-4bbf-8e2e-c974217c4733 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:26:10.585961 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-f2dbebac-6ce1-4bbf-8e2e-c974217c4733 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: 496ce05f-ecc0-4dfd-b1d4-1c961f763af7] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:26:10.592798 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-f2dbebac-6ce1-4bbf-8e2e-c974217c4733 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:26:10.593246 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-f2dbebac-6ce1-4bbf-8e2e-c974217c4733 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:26:10.594031 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-f2dbebac-6ce1-4bbf-8e2e-c974217c4733 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:26:10.594466 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-f2dbebac-6ce1-4bbf-8e2e-c974217c4733 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:26:10.639814 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-69b88e19-3ba1-4df8-8750-ff631c49f7df tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "POST /compute/v2.1/servers/e5d549b4-7eb7-4cdd-90f0-ead23b7df090/action" status: 200 len: 23235 microversion: 2.1 time: 0.088612 Nov 22 12:26:10.640449 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 537/1148] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Nov 22 12:26:10 2021] POST /compute/v2.1/servers/e5d549b4-7eb7-4cdd-90f0-ead23b7df090/action => generated 23235 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 12:26:10.768733 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-f2dbebac-6ce1-4bbf-8e2e-c974217c4733 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:26:10.779113 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-f2dbebac-6ce1-4bbf-8e2e-c974217c4733 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:26:10.780627 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-f2dbebac-6ce1-4bbf-8e2e-c974217c4733 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:26:10.781768 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-f2dbebac-6ce1-4bbf-8e2e-c974217c4733 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "GET /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7" status: 200 len: 1728 microversion: 2.20 time: 0.200255 Nov 22 12:26:10.782401 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 612/1149] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Nov 22 12:26:10 2021] GET /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7 => generated 1728 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 12:26:11.656339 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-07efc286-d8dd-44da-a3f1-125fe4b46ab2 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:26:11.657729 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-07efc286-d8dd-44da-a3f1-125fe4b46ab2 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: e5d549b4-7eb7-4cdd-90f0-ead23b7df090] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:26:11.667909 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-07efc286-d8dd-44da-a3f1-125fe4b46ab2 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:26:11.668361 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-07efc286-d8dd-44da-a3f1-125fe4b46ab2 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:26:11.669149 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-07efc286-d8dd-44da-a3f1-125fe4b46ab2 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:26:11.669585 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-07efc286-d8dd-44da-a3f1-125fe4b46ab2 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:26:11.743683 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-07efc286-d8dd-44da-a3f1-125fe4b46ab2 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "POST /compute/v2.1/servers/e5d549b4-7eb7-4cdd-90f0-ead23b7df090/action" status: 200 len: 24881 microversion: 2.1 time: 0.093675 Nov 22 12:26:11.744247 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 538/1150] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Nov 22 12:26:11 2021] POST /compute/v2.1/servers/e5d549b4-7eb7-4cdd-90f0-ead23b7df090/action => generated 24881 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 12:26:11.799722 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-f14162e3-b3d5-499e-b417-ae361de15300 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:26:11.800277 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-f14162e3-b3d5-499e-b417-ae361de15300 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: 496ce05f-ecc0-4dfd-b1d4-1c961f763af7] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:26:11.807190 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-f14162e3-b3d5-499e-b417-ae361de15300 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:26:11.807692 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-f14162e3-b3d5-499e-b417-ae361de15300 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:26:11.808468 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-f14162e3-b3d5-499e-b417-ae361de15300 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:26:11.808953 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-f14162e3-b3d5-499e-b417-ae361de15300 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:26:11.961482 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-f14162e3-b3d5-499e-b417-ae361de15300 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:26:11.973755 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-f14162e3-b3d5-499e-b417-ae361de15300 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:26:11.976023 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-f14162e3-b3d5-499e-b417-ae361de15300 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:26:11.977491 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-f14162e3-b3d5-499e-b417-ae361de15300 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "GET /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7" status: 200 len: 1728 microversion: 2.20 time: 0.181384 Nov 22 12:26:11.978266 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 613/1151] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Nov 22 12:26:11 2021] GET /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7 => generated 1728 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 12:26:12.760037 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-48b8714b-6bfb-4101-a28a-6d343fdbf1d3 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:26:12.761148 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-48b8714b-6bfb-4101-a28a-6d343fdbf1d3 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: e5d549b4-7eb7-4cdd-90f0-ead23b7df090] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:26:12.771978 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-48b8714b-6bfb-4101-a28a-6d343fdbf1d3 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:26:12.772529 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-48b8714b-6bfb-4101-a28a-6d343fdbf1d3 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:26:12.773746 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-48b8714b-6bfb-4101-a28a-6d343fdbf1d3 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:26:12.774391 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-48b8714b-6bfb-4101-a28a-6d343fdbf1d3 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:26:13.004550 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-406448ee-7862-4d7a-aad6-0d8111a46feb tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:26:13.005229 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-406448ee-7862-4d7a-aad6-0d8111a46feb tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: 496ce05f-ecc0-4dfd-b1d4-1c961f763af7] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:26:13.012908 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-406448ee-7862-4d7a-aad6-0d8111a46feb tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:26:13.013301 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-406448ee-7862-4d7a-aad6-0d8111a46feb tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:26:13.014125 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-406448ee-7862-4d7a-aad6-0d8111a46feb tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:26:13.014538 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-406448ee-7862-4d7a-aad6-0d8111a46feb tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:26:13.015433 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-48b8714b-6bfb-4101-a28a-6d343fdbf1d3 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "POST /compute/v2.1/servers/e5d549b4-7eb7-4cdd-90f0-ead23b7df090/action" status: 200 len: 26665 microversion: 2.1 time: 0.261100 Nov 22 12:26:13.016096 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 539/1152] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Nov 22 12:26:12 2021] POST /compute/v2.1/servers/e5d549b4-7eb7-4cdd-90f0-ead23b7df090/action => generated 26665 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 12:26:13.160577 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-406448ee-7862-4d7a-aad6-0d8111a46feb tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:26:13.171107 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-406448ee-7862-4d7a-aad6-0d8111a46feb tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:26:13.172629 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-406448ee-7862-4d7a-aad6-0d8111a46feb tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:26:13.173800 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-406448ee-7862-4d7a-aad6-0d8111a46feb tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "GET /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7" status: 200 len: 1728 microversion: 2.20 time: 0.174474 Nov 22 12:26:13.174354 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 614/1153] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Nov 22 12:26:12 2021] GET /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7 => generated 1728 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 12:26:14.029931 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-f1acfa34-e5dc-420a-9575-a9d929d87225 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:26:14.030948 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-f1acfa34-e5dc-420a-9575-a9d929d87225 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: e5d549b4-7eb7-4cdd-90f0-ead23b7df090] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:26:14.038194 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-f1acfa34-e5dc-420a-9575-a9d929d87225 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:26:14.038662 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-f1acfa34-e5dc-420a-9575-a9d929d87225 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:26:14.039490 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-f1acfa34-e5dc-420a-9575-a9d929d87225 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:26:14.039930 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-f1acfa34-e5dc-420a-9575-a9d929d87225 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:26:14.126477 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-f1acfa34-e5dc-420a-9575-a9d929d87225 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "POST /compute/v2.1/servers/e5d549b4-7eb7-4cdd-90f0-ead23b7df090/action" status: 200 len: 27588 microversion: 2.1 time: 0.101267 Nov 22 12:26:14.127079 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 540/1154] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Nov 22 12:26:14 2021] POST /compute/v2.1/servers/e5d549b4-7eb7-4cdd-90f0-ead23b7df090/action => generated 27588 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 12:26:14.192848 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-3d7a1b95-1c52-4631-89a3-e627b5501c84 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:26:14.193481 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-3d7a1b95-1c52-4631-89a3-e627b5501c84 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: 496ce05f-ecc0-4dfd-b1d4-1c961f763af7] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:26:14.200568 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-3d7a1b95-1c52-4631-89a3-e627b5501c84 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:26:14.201028 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-3d7a1b95-1c52-4631-89a3-e627b5501c84 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:26:14.201801 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-3d7a1b95-1c52-4631-89a3-e627b5501c84 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:26:14.202263 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-3d7a1b95-1c52-4631-89a3-e627b5501c84 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:26:14.354021 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-3d7a1b95-1c52-4631-89a3-e627b5501c84 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:26:14.362263 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-3d7a1b95-1c52-4631-89a3-e627b5501c84 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:26:14.363780 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-3d7a1b95-1c52-4631-89a3-e627b5501c84 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:26:14.364996 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-3d7a1b95-1c52-4631-89a3-e627b5501c84 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "GET /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7" status: 200 len: 1728 microversion: 2.20 time: 0.175975 Nov 22 12:26:14.365510 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 615/1155] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Nov 22 12:26:14 2021] GET /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7 => generated 1728 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 12:26:15.140699 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-f019849c-3b51-4912-a257-2bb2328def14 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:26:15.141725 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-f019849c-3b51-4912-a257-2bb2328def14 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: e5d549b4-7eb7-4cdd-90f0-ead23b7df090] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:26:15.149441 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-f019849c-3b51-4912-a257-2bb2328def14 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:26:15.149951 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-f019849c-3b51-4912-a257-2bb2328def14 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:26:15.150683 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-f019849c-3b51-4912-a257-2bb2328def14 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:26:15.151110 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-f019849c-3b51-4912-a257-2bb2328def14 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:26:15.231514 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-f019849c-3b51-4912-a257-2bb2328def14 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "POST /compute/v2.1/servers/e5d549b4-7eb7-4cdd-90f0-ead23b7df090/action" status: 200 len: 28049 microversion: 2.1 time: 0.094798 Nov 22 12:26:15.232160 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 541/1156] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Nov 22 12:26:15 2021] POST /compute/v2.1/servers/e5d549b4-7eb7-4cdd-90f0-ead23b7df090/action => generated 28049 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 12:26:15.385444 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-844e717a-d1b7-4aa9-990b-99fac17f4829 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:26:15.386019 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-844e717a-d1b7-4aa9-990b-99fac17f4829 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: 496ce05f-ecc0-4dfd-b1d4-1c961f763af7] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:26:15.393042 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-844e717a-d1b7-4aa9-990b-99fac17f4829 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:26:15.393491 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-844e717a-d1b7-4aa9-990b-99fac17f4829 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:26:15.394275 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-844e717a-d1b7-4aa9-990b-99fac17f4829 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:26:15.394703 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-844e717a-d1b7-4aa9-990b-99fac17f4829 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:26:15.537612 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-844e717a-d1b7-4aa9-990b-99fac17f4829 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:26:15.546422 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-844e717a-d1b7-4aa9-990b-99fac17f4829 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:26:15.547897 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-844e717a-d1b7-4aa9-990b-99fac17f4829 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:26:15.549038 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-844e717a-d1b7-4aa9-990b-99fac17f4829 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "GET /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7" status: 200 len: 1728 microversion: 2.20 time: 0.167695 Nov 22 12:26:15.549904 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 616/1157] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Nov 22 12:26:15 2021] GET /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7 => generated 1728 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 12:26:15.593149 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [req-d2552a40-0611-479b-b308-7d85d7ca8c12 req-b37d14eb-caaf-41a4-b9f1-ded953aa6840 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "496ce05f-ecc0-4dfd-b1d4-1c961f763af7", "name": "network-vif-plugged", "status": "completed", "tag": "94a1cac1-1361-4086-b60b-55660b9c75fc"}]} {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:26:15.594683 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 12:26:15.594683 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: warnings.warn(msg) Nov 22 12:26:15.603643 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [req-d2552a40-0611-479b-b308-7d85d7ca8c12 req-b37d14eb-caaf-41a4-b9f1-ded953aa6840 service nova] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:26:15.604084 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [req-d2552a40-0611-479b-b308-7d85d7ca8c12 req-b37d14eb-caaf-41a4-b9f1-ded953aa6840 service nova] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:26:15.617066 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.compute.server_external_events [req-d2552a40-0611-479b-b308-7d85d7ca8c12 req-b37d14eb-caaf-41a4-b9f1-ded953aa6840 service nova] Creating event network-vif-plugged:94a1cac1-1361-4086-b60b-55660b9c75fc for instance 496ce05f-ecc0-4dfd-b1d4-1c961f763af7 on hv-cinder-76845 Nov 22 12:26:15.623678 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [req-d2552a40-0611-479b-b308-7d85d7ca8c12 req-b37d14eb-caaf-41a4-b9f1-ded953aa6840 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034639 Nov 22 12:26:15.624277 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 542/1158] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Nov 22 12:26:15 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 12:26:16.243634 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-361d001a-5f06-40a1-b248-597c7b29cb2a tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:26:16.244617 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-361d001a-5f06-40a1-b248-597c7b29cb2a tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: e5d549b4-7eb7-4cdd-90f0-ead23b7df090] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:26:16.251994 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-361d001a-5f06-40a1-b248-597c7b29cb2a tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:26:16.252457 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-361d001a-5f06-40a1-b248-597c7b29cb2a tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:26:16.253236 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-361d001a-5f06-40a1-b248-597c7b29cb2a tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:26:16.253671 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-361d001a-5f06-40a1-b248-597c7b29cb2a tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:26:16.337690 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-361d001a-5f06-40a1-b248-597c7b29cb2a tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "POST /compute/v2.1/servers/e5d549b4-7eb7-4cdd-90f0-ead23b7df090/action" status: 200 len: 28194 microversion: 2.1 time: 0.097619 Nov 22 12:26:16.338348 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 617/1159] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Nov 22 12:26:16 2021] POST /compute/v2.1/servers/e5d549b4-7eb7-4cdd-90f0-ead23b7df090/action => generated 28194 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 12:26:16.571590 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-2aeba06e-8ecd-40d5-97f7-6d2b94657493 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:26:16.572166 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-2aeba06e-8ecd-40d5-97f7-6d2b94657493 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: 496ce05f-ecc0-4dfd-b1d4-1c961f763af7] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:26:16.580545 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-2aeba06e-8ecd-40d5-97f7-6d2b94657493 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:26:16.580989 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-2aeba06e-8ecd-40d5-97f7-6d2b94657493 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:26:16.581771 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-2aeba06e-8ecd-40d5-97f7-6d2b94657493 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:26:16.582198 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-2aeba06e-8ecd-40d5-97f7-6d2b94657493 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:26:16.724859 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-2aeba06e-8ecd-40d5-97f7-6d2b94657493 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:26:16.733321 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-2aeba06e-8ecd-40d5-97f7-6d2b94657493 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:26:16.734777 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-2aeba06e-8ecd-40d5-97f7-6d2b94657493 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:26:16.735988 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-2aeba06e-8ecd-40d5-97f7-6d2b94657493 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "GET /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7" status: 200 len: 1728 microversion: 2.20 time: 0.171281 Nov 22 12:26:16.736533 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 543/1160] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Nov 22 12:26:16 2021] GET /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7 => generated 1728 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 12:26:17.350676 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-44938ea8-c869-4a7b-bd69-c8d3a99efa8b tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:26:17.351731 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-44938ea8-c869-4a7b-bd69-c8d3a99efa8b tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: e5d549b4-7eb7-4cdd-90f0-ead23b7df090] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:26:17.359721 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-44938ea8-c869-4a7b-bd69-c8d3a99efa8b tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:26:17.360128 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-44938ea8-c869-4a7b-bd69-c8d3a99efa8b tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:26:17.360999 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-44938ea8-c869-4a7b-bd69-c8d3a99efa8b tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:26:17.361441 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-44938ea8-c869-4a7b-bd69-c8d3a99efa8b tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:26:17.428418 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-44938ea8-c869-4a7b-bd69-c8d3a99efa8b tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "POST /compute/v2.1/servers/e5d549b4-7eb7-4cdd-90f0-ead23b7df090/action" status: 200 len: 28194 microversion: 2.1 time: 0.081750 Nov 22 12:26:17.429293 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 618/1161] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Nov 22 12:26:17 2021] POST /compute/v2.1/servers/e5d549b4-7eb7-4cdd-90f0-ead23b7df090/action => generated 28194 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 12:26:17.755375 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-8f68ce42-6011-463f-89b0-9359e865bc5c tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:26:17.756056 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-8f68ce42-6011-463f-89b0-9359e865bc5c tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: 496ce05f-ecc0-4dfd-b1d4-1c961f763af7] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:26:17.763079 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-8f68ce42-6011-463f-89b0-9359e865bc5c tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:26:17.763550 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-8f68ce42-6011-463f-89b0-9359e865bc5c tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:26:17.764330 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-8f68ce42-6011-463f-89b0-9359e865bc5c tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:26:17.764755 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-8f68ce42-6011-463f-89b0-9359e865bc5c tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:26:17.905161 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-8f68ce42-6011-463f-89b0-9359e865bc5c tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:26:17.913421 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-8f68ce42-6011-463f-89b0-9359e865bc5c tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:26:17.914898 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-8f68ce42-6011-463f-89b0-9359e865bc5c tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:26:17.916116 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-8f68ce42-6011-463f-89b0-9359e865bc5c tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "GET /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7" status: 200 len: 1728 microversion: 2.20 time: 0.164559 Nov 22 12:26:17.916745 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 544/1162] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Nov 22 12:26:17 2021] GET /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7 => generated 1728 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 12:26:18.441234 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-e809a9ef-0a53-45be-94be-f7c3e1b1ae87 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:26:18.442146 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-e809a9ef-0a53-45be-94be-f7c3e1b1ae87 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: e5d549b4-7eb7-4cdd-90f0-ead23b7df090] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:26:18.449176 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-e809a9ef-0a53-45be-94be-f7c3e1b1ae87 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:26:18.449626 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-e809a9ef-0a53-45be-94be-f7c3e1b1ae87 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:26:18.450407 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-e809a9ef-0a53-45be-94be-f7c3e1b1ae87 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:26:18.450836 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-e809a9ef-0a53-45be-94be-f7c3e1b1ae87 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:26:18.531419 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-e809a9ef-0a53-45be-94be-f7c3e1b1ae87 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "POST /compute/v2.1/servers/e5d549b4-7eb7-4cdd-90f0-ead23b7df090/action" status: 200 len: 28485 microversion: 2.1 time: 0.093999 Nov 22 12:26:18.532185 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 619/1163] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Nov 22 12:26:18 2021] POST /compute/v2.1/servers/e5d549b4-7eb7-4cdd-90f0-ead23b7df090/action => generated 28485 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 12:26:18.934469 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-4cad9e0d-72e5-4b7f-a4a9-21c25f79f698 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:26:18.935051 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-4cad9e0d-72e5-4b7f-a4a9-21c25f79f698 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: 496ce05f-ecc0-4dfd-b1d4-1c961f763af7] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:26:18.942395 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-4cad9e0d-72e5-4b7f-a4a9-21c25f79f698 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:26:18.942910 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-4cad9e0d-72e5-4b7f-a4a9-21c25f79f698 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:26:18.943831 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-4cad9e0d-72e5-4b7f-a4a9-21c25f79f698 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:26:18.944307 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-4cad9e0d-72e5-4b7f-a4a9-21c25f79f698 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:26:19.086705 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-4cad9e0d-72e5-4b7f-a4a9-21c25f79f698 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:26:19.095550 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-4cad9e0d-72e5-4b7f-a4a9-21c25f79f698 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:26:19.097033 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-4cad9e0d-72e5-4b7f-a4a9-21c25f79f698 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:26:19.098185 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-4cad9e0d-72e5-4b7f-a4a9-21c25f79f698 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "GET /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7" status: 200 len: 1715 microversion: 2.20 time: 0.167834 Nov 22 12:26:19.098742 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 545/1164] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Nov 22 12:26:18 2021] GET /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7 => generated 1715 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 12:26:19.544786 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-ec4e4461-5f78-4ed6-bc15-3ff9fe12c506 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:26:19.545902 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-ec4e4461-5f78-4ed6-bc15-3ff9fe12c506 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: e5d549b4-7eb7-4cdd-90f0-ead23b7df090] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:26:19.554791 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-ec4e4461-5f78-4ed6-bc15-3ff9fe12c506 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:26:19.555333 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-ec4e4461-5f78-4ed6-bc15-3ff9fe12c506 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:26:19.556223 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-ec4e4461-5f78-4ed6-bc15-3ff9fe12c506 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:26:19.556654 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-ec4e4461-5f78-4ed6-bc15-3ff9fe12c506 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:26:19.636477 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-ec4e4461-5f78-4ed6-bc15-3ff9fe12c506 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "POST /compute/v2.1/servers/e5d549b4-7eb7-4cdd-90f0-ead23b7df090/action" status: 200 len: 28653 microversion: 2.1 time: 0.096357 Nov 22 12:26:19.637198 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 620/1165] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Nov 22 12:26:19 2021] POST /compute/v2.1/servers/e5d549b4-7eb7-4cdd-90f0-ead23b7df090/action => generated 28653 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 12:26:20.649145 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-9b18f7fd-55b0-4774-8e99-e2e33c6afcab tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:26:20.650092 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-9b18f7fd-55b0-4774-8e99-e2e33c6afcab tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: e5d549b4-7eb7-4cdd-90f0-ead23b7df090] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:26:20.657393 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-9b18f7fd-55b0-4774-8e99-e2e33c6afcab tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:26:20.657842 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-9b18f7fd-55b0-4774-8e99-e2e33c6afcab tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:26:20.658617 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-9b18f7fd-55b0-4774-8e99-e2e33c6afcab tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:26:20.659043 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-9b18f7fd-55b0-4774-8e99-e2e33c6afcab tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:26:20.725905 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-9b18f7fd-55b0-4774-8e99-e2e33c6afcab tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "POST /compute/v2.1/servers/e5d549b4-7eb7-4cdd-90f0-ead23b7df090/action" status: 200 len: 28653 microversion: 2.1 time: 0.080077 Nov 22 12:26:20.726663 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 546/1166] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Nov 22 12:26:20 2021] POST /compute/v2.1/servers/e5d549b4-7eb7-4cdd-90f0-ead23b7df090/action => generated 28653 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 12:26:21.738989 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-9e0cd748-3773-49fc-b317-498b105ec9c8 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:26:21.740106 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-9e0cd748-3773-49fc-b317-498b105ec9c8 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: e5d549b4-7eb7-4cdd-90f0-ead23b7df090] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:26:21.747842 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-9e0cd748-3773-49fc-b317-498b105ec9c8 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:26:21.748287 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-9e0cd748-3773-49fc-b317-498b105ec9c8 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:26:21.749073 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-9e0cd748-3773-49fc-b317-498b105ec9c8 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:26:21.749498 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-9e0cd748-3773-49fc-b317-498b105ec9c8 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:26:21.813621 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-9e0cd748-3773-49fc-b317-498b105ec9c8 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "POST /compute/v2.1/servers/e5d549b4-7eb7-4cdd-90f0-ead23b7df090/action" status: 200 len: 28653 microversion: 2.1 time: 0.078702 Nov 22 12:26:21.814307 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 621/1167] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Nov 22 12:26:21 2021] POST /compute/v2.1/servers/e5d549b4-7eb7-4cdd-90f0-ead23b7df090/action => generated 28653 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 12:26:22.827895 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-43f95732-e7b9-4623-be39-afa2e9df6d4a tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:26:22.828879 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-43f95732-e7b9-4623-be39-afa2e9df6d4a tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: e5d549b4-7eb7-4cdd-90f0-ead23b7df090] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:26:22.836067 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-43f95732-e7b9-4623-be39-afa2e9df6d4a tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:26:22.836523 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-43f95732-e7b9-4623-be39-afa2e9df6d4a tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:26:22.837292 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-43f95732-e7b9-4623-be39-afa2e9df6d4a tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:26:22.837713 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-43f95732-e7b9-4623-be39-afa2e9df6d4a tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:26:22.922527 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-43f95732-e7b9-4623-be39-afa2e9df6d4a tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "POST /compute/v2.1/servers/e5d549b4-7eb7-4cdd-90f0-ead23b7df090/action" status: 200 len: 29869 microversion: 2.1 time: 0.099158 Nov 22 12:26:22.923177 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 547/1168] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Nov 22 12:26:22 2021] POST /compute/v2.1/servers/e5d549b4-7eb7-4cdd-90f0-ead23b7df090/action => generated 29869 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 12:26:23.936362 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-e15ab1f7-86df-4975-81f4-b886dd0de919 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:26:23.937250 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-e15ab1f7-86df-4975-81f4-b886dd0de919 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: e5d549b4-7eb7-4cdd-90f0-ead23b7df090] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:26:23.944576 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-e15ab1f7-86df-4975-81f4-b886dd0de919 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:26:23.945101 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-e15ab1f7-86df-4975-81f4-b886dd0de919 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:26:23.945896 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-e15ab1f7-86df-4975-81f4-b886dd0de919 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:26:23.946324 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-e15ab1f7-86df-4975-81f4-b886dd0de919 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:26:24.021531 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-e15ab1f7-86df-4975-81f4-b886dd0de919 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "POST /compute/v2.1/servers/e5d549b4-7eb7-4cdd-90f0-ead23b7df090/action" status: 200 len: 31944 microversion: 2.1 time: 0.089575 Nov 22 12:26:24.022194 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 622/1169] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Nov 22 12:26:23 2021] POST /compute/v2.1/servers/e5d549b4-7eb7-4cdd-90f0-ead23b7df090/action => generated 31944 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 12:26:25.036158 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-658352d9-be3d-4d01-9664-f75661385362 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:26:25.037169 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-658352d9-be3d-4d01-9664-f75661385362 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: e5d549b4-7eb7-4cdd-90f0-ead23b7df090] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:26:25.044760 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-658352d9-be3d-4d01-9664-f75661385362 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:26:25.045210 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-658352d9-be3d-4d01-9664-f75661385362 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:26:25.046049 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-658352d9-be3d-4d01-9664-f75661385362 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:26:25.046445 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-658352d9-be3d-4d01-9664-f75661385362 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:26:25.137360 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-658352d9-be3d-4d01-9664-f75661385362 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "POST /compute/v2.1/servers/e5d549b4-7eb7-4cdd-90f0-ead23b7df090/action" status: 200 len: 33495 microversion: 2.1 time: 0.104823 Nov 22 12:26:25.138265 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 548/1170] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Nov 22 12:26:25 2021] POST /compute/v2.1/servers/e5d549b4-7eb7-4cdd-90f0-ead23b7df090/action => generated 33495 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 12:26:26.150829 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-f6969ba9-371b-4766-9013-0d40e70035b4 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:26:26.151924 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-f6969ba9-371b-4766-9013-0d40e70035b4 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: e5d549b4-7eb7-4cdd-90f0-ead23b7df090] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:26:26.160173 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-f6969ba9-371b-4766-9013-0d40e70035b4 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:26:26.160624 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-f6969ba9-371b-4766-9013-0d40e70035b4 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:26:26.161410 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-f6969ba9-371b-4766-9013-0d40e70035b4 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:26:26.161843 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-f6969ba9-371b-4766-9013-0d40e70035b4 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:26:26.244358 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-f6969ba9-371b-4766-9013-0d40e70035b4 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "POST /compute/v2.1/servers/e5d549b4-7eb7-4cdd-90f0-ead23b7df090/action" status: 200 len: 34586 microversion: 2.1 time: 0.097617 Nov 22 12:26:26.245001 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 623/1171] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Nov 22 12:26:26 2021] POST /compute/v2.1/servers/e5d549b4-7eb7-4cdd-90f0-ead23b7df090/action => generated 34586 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 12:26:27.258235 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-bfa72ea4-d0fa-4901-a389-ff8071cefe0e tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:26:27.259315 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-bfa72ea4-d0fa-4901-a389-ff8071cefe0e tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: e5d549b4-7eb7-4cdd-90f0-ead23b7df090] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:26:27.267120 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-bfa72ea4-d0fa-4901-a389-ff8071cefe0e tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:26:27.267603 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-bfa72ea4-d0fa-4901-a389-ff8071cefe0e tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:26:27.268394 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-bfa72ea4-d0fa-4901-a389-ff8071cefe0e tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:26:27.268838 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-bfa72ea4-d0fa-4901-a389-ff8071cefe0e tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:26:27.347142 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-bfa72ea4-d0fa-4901-a389-ff8071cefe0e tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "POST /compute/v2.1/servers/e5d549b4-7eb7-4cdd-90f0-ead23b7df090/action" status: 200 len: 35530 microversion: 2.1 time: 0.092879 Nov 22 12:26:27.347807 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 549/1172] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Nov 22 12:26:27 2021] POST /compute/v2.1/servers/e5d549b4-7eb7-4cdd-90f0-ead23b7df090/action => generated 35530 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 12:26:28.360167 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-7c043bb2-6d94-417e-a994-c3916f2a320b tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:26:28.361215 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-7c043bb2-6d94-417e-a994-c3916f2a320b tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: e5d549b4-7eb7-4cdd-90f0-ead23b7df090] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:26:28.368588 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-7c043bb2-6d94-417e-a994-c3916f2a320b tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:26:28.369033 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-7c043bb2-6d94-417e-a994-c3916f2a320b tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:26:28.369810 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-7c043bb2-6d94-417e-a994-c3916f2a320b tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:26:28.370240 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-7c043bb2-6d94-417e-a994-c3916f2a320b tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:26:28.447274 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-7c043bb2-6d94-417e-a994-c3916f2a320b tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "POST /compute/v2.1/servers/e5d549b4-7eb7-4cdd-90f0-ead23b7df090/action" status: 200 len: 37002 microversion: 2.1 time: 0.091082 Nov 22 12:26:28.447911 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 624/1173] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Nov 22 12:26:28 2021] POST /compute/v2.1/servers/e5d549b4-7eb7-4cdd-90f0-ead23b7df090/action => generated 37002 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 12:26:29.464436 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-680213f7-efc5-4015-af80-fdbffa0b9747 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:26:29.465539 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-680213f7-efc5-4015-af80-fdbffa0b9747 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: e5d549b4-7eb7-4cdd-90f0-ead23b7df090] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:26:29.476602 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-680213f7-efc5-4015-af80-fdbffa0b9747 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:26:29.477246 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-680213f7-efc5-4015-af80-fdbffa0b9747 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:26:29.478251 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-680213f7-efc5-4015-af80-fdbffa0b9747 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:26:29.478779 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-680213f7-efc5-4015-af80-fdbffa0b9747 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:26:29.562271 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-680213f7-efc5-4015-af80-fdbffa0b9747 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "POST /compute/v2.1/servers/e5d549b4-7eb7-4cdd-90f0-ead23b7df090/action" status: 200 len: 38180 microversion: 2.1 time: 0.104232 Nov 22 12:26:29.562940 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 550/1174] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Nov 22 12:26:29 2021] POST /compute/v2.1/servers/e5d549b4-7eb7-4cdd-90f0-ead23b7df090/action => generated 38180 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 12:26:30.574973 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-e8870963-e9d1-474c-8f5f-2ff718d6e25a tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:26:30.576027 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-e8870963-e9d1-474c-8f5f-2ff718d6e25a tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: e5d549b4-7eb7-4cdd-90f0-ead23b7df090] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:26:30.583745 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-e8870963-e9d1-474c-8f5f-2ff718d6e25a tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:26:30.584192 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-e8870963-e9d1-474c-8f5f-2ff718d6e25a tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:26:30.584968 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-e8870963-e9d1-474c-8f5f-2ff718d6e25a tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:26:30.585396 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-e8870963-e9d1-474c-8f5f-2ff718d6e25a tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:26:30.649825 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-e8870963-e9d1-474c-8f5f-2ff718d6e25a tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "POST /compute/v2.1/servers/e5d549b4-7eb7-4cdd-90f0-ead23b7df090/action" status: 200 len: 38180 microversion: 2.1 time: 0.078797 Nov 22 12:26:30.650457 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 625/1175] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Nov 22 12:26:30 2021] POST /compute/v2.1/servers/e5d549b4-7eb7-4cdd-90f0-ead23b7df090/action => generated 38180 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 12:26:31.663031 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-65a9f0d5-569a-4f10-8d8b-0993437635d6 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:26:31.664069 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-65a9f0d5-569a-4f10-8d8b-0993437635d6 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: e5d549b4-7eb7-4cdd-90f0-ead23b7df090] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:26:31.671609 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-65a9f0d5-569a-4f10-8d8b-0993437635d6 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:26:31.672317 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-65a9f0d5-569a-4f10-8d8b-0993437635d6 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:26:31.673129 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-65a9f0d5-569a-4f10-8d8b-0993437635d6 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:26:31.673571 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-65a9f0d5-569a-4f10-8d8b-0993437635d6 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:26:31.736856 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-65a9f0d5-569a-4f10-8d8b-0993437635d6 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "POST /compute/v2.1/servers/e5d549b4-7eb7-4cdd-90f0-ead23b7df090/action" status: 200 len: 38180 microversion: 2.1 time: 0.077854 Nov 22 12:26:31.737522 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 551/1176] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Nov 22 12:26:31 2021] POST /compute/v2.1/servers/e5d549b4-7eb7-4cdd-90f0-ead23b7df090/action => generated 38180 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 12:26:32.753152 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-e6eb945a-706b-4fee-9f39-9ac0e351ae96 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:26:32.754056 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-e6eb945a-706b-4fee-9f39-9ac0e351ae96 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: e5d549b4-7eb7-4cdd-90f0-ead23b7df090] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:26:32.761294 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-e6eb945a-706b-4fee-9f39-9ac0e351ae96 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:26:32.761743 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-e6eb945a-706b-4fee-9f39-9ac0e351ae96 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:26:32.762522 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-e6eb945a-706b-4fee-9f39-9ac0e351ae96 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:26:32.762958 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-e6eb945a-706b-4fee-9f39-9ac0e351ae96 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:26:32.842336 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-e6eb945a-706b-4fee-9f39-9ac0e351ae96 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "POST /compute/v2.1/servers/e5d549b4-7eb7-4cdd-90f0-ead23b7df090/action" status: 200 len: 38180 microversion: 2.1 time: 0.095967 Nov 22 12:26:32.842961 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 626/1177] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Nov 22 12:26:32 2021] POST /compute/v2.1/servers/e5d549b4-7eb7-4cdd-90f0-ead23b7df090/action => generated 38180 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 12:26:33.856825 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-85021205-6122-406b-a3dd-cfad9be5596b tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:26:33.857829 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-85021205-6122-406b-a3dd-cfad9be5596b tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: e5d549b4-7eb7-4cdd-90f0-ead23b7df090] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:26:33.868708 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-85021205-6122-406b-a3dd-cfad9be5596b tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:26:33.869439 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-85021205-6122-406b-a3dd-cfad9be5596b tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:26:33.870674 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-85021205-6122-406b-a3dd-cfad9be5596b tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:26:33.871439 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-85021205-6122-406b-a3dd-cfad9be5596b tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:26:33.953901 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-85021205-6122-406b-a3dd-cfad9be5596b tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "POST /compute/v2.1/servers/e5d549b4-7eb7-4cdd-90f0-ead23b7df090/action" status: 200 len: 38311 microversion: 2.1 time: 0.102148 Nov 22 12:26:33.954702 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 552/1178] 10.222.0.66 () {60 vars in 1277 bytes} [Mon Nov 22 12:26:33 2021] POST /compute/v2.1/servers/e5d549b4-7eb7-4cdd-90f0-ead23b7df090/action => generated 38311 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 22 12:26:33.965472 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-7c516f24-838d-4a55-beb8-be3c5acddc80 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:26:33.966047 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-7c516f24-838d-4a55-beb8-be3c5acddc80 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: e5d549b4-7eb7-4cdd-90f0-ead23b7df090] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:26:33.973544 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-7c516f24-838d-4a55-beb8-be3c5acddc80 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:26:33.974002 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-7c516f24-838d-4a55-beb8-be3c5acddc80 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:26:33.974794 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-7c516f24-838d-4a55-beb8-be3c5acddc80 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:26:33.975249 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-7c516f24-838d-4a55-beb8-be3c5acddc80 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:26:33.999567 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-7c516f24-838d-4a55-beb8-be3c5acddc80 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "GET /compute/v2.1/servers/e5d549b4-7eb7-4cdd-90f0-ead23b7df090/ips" status: 200 len: 145 microversion: 2.1 time: 0.038089 Nov 22 12:26:34.000137 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 627/1179] 10.222.0.66 () {58 vars in 1247 bytes} [Mon Nov 22 12:26:33 2021] GET /compute/v2.1/servers/e5d549b4-7eb7-4cdd-90f0-ead23b7df090/ips => generated 145 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 12:26:35.334499 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-662ce75a-0e6a-4766-90f0-709c749238e7 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "70fe6365-2233-4740-8adf-8d1e91d87e9b"}} {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:26:35.335675 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-662ce75a-0e6a-4766-90f0-709c749238e7 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: e5d549b4-7eb7-4cdd-90f0-ead23b7df090] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:26:35.342896 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-662ce75a-0e6a-4766-90f0-709c749238e7 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:26:35.343389 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-662ce75a-0e6a-4766-90f0-709c749238e7 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:26:35.344176 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-662ce75a-0e6a-4766-90f0-709c749238e7 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:26:35.344603 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-662ce75a-0e6a-4766-90f0-709c749238e7 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:26:35.602049 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-662ce75a-0e6a-4766-90f0-709c749238e7 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "POST /compute/v2.1/servers/e5d549b4-7eb7-4cdd-90f0-ead23b7df090/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.272153 Nov 22 12:26:35.602747 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 553/1180] 10.222.0.66 () {60 vars in 1322 bytes} [Mon Nov 22 12:26:35 2021] POST /compute/v2.1/servers/e5d549b4-7eb7-4cdd-90f0-ead23b7df090/os-volume_attachments => generated 194 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 12:26:42.052716 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-1819b110-ca76-4673-b718-b39fc07f0758 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:26:42.053668 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-1819b110-ca76-4673-b718-b39fc07f0758 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: e5d549b4-7eb7-4cdd-90f0-ead23b7df090] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:26:42.060535 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-1819b110-ca76-4673-b718-b39fc07f0758 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:26:42.060958 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-1819b110-ca76-4673-b718-b39fc07f0758 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:26:42.061715 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-1819b110-ca76-4673-b718-b39fc07f0758 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:26:42.062151 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-1819b110-ca76-4673-b718-b39fc07f0758 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:26:42.093428 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-1819b110-ca76-4673-b718-b39fc07f0758 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "GET /compute/v2.1/servers/e5d549b4-7eb7-4cdd-90f0-ead23b7df090/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044582 Nov 22 12:26:42.093985 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 628/1181] 10.222.0.66 () {58 vars in 1301 bytes} [Mon Nov 22 12:26:42 2021] GET /compute/v2.1/servers/e5d549b4-7eb7-4cdd-90f0-ead23b7df090/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 12:26:42.108097 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-814723a8-750f-4d3c-9fe1-d1702bb4e9e7 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:26:42.108959 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-814723a8-750f-4d3c-9fe1-d1702bb4e9e7 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: e5d549b4-7eb7-4cdd-90f0-ead23b7df090] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:26:42.117410 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-814723a8-750f-4d3c-9fe1-d1702bb4e9e7 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:26:42.117849 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-814723a8-750f-4d3c-9fe1-d1702bb4e9e7 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:26:42.118630 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-814723a8-750f-4d3c-9fe1-d1702bb4e9e7 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:26:42.119064 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-814723a8-750f-4d3c-9fe1-d1702bb4e9e7 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:26:42.150551 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-814723a8-750f-4d3c-9fe1-d1702bb4e9e7 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "GET /compute/v2.1/servers/e5d549b4-7eb7-4cdd-90f0-ead23b7df090/os-volume_attachments/70fe6365-2233-4740-8adf-8d1e91d87e9b" status: 200 len: 194 microversion: 2.1 time: 0.049745 Nov 22 12:26:42.151151 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 554/1182] 10.222.0.66 () {58 vars in 1412 bytes} [Mon Nov 22 12:26:42 2021] GET /compute/v2.1/servers/e5d549b4-7eb7-4cdd-90f0-ead23b7df090/os-volume_attachments/70fe6365-2233-4740-8adf-8d1e91d87e9b => generated 194 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 12:26:43.478740 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-46376eba-f1a8-4915-97a3-3cb6b82d9923 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "36203589-b05e-462f-96dd-101411080ff2"}} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:26:43.479841 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-46376eba-f1a8-4915-97a3-3cb6b82d9923 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: e5d549b4-7eb7-4cdd-90f0-ead23b7df090] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:26:43.486516 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-46376eba-f1a8-4915-97a3-3cb6b82d9923 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:26:43.486968 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-46376eba-f1a8-4915-97a3-3cb6b82d9923 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:26:43.487798 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-46376eba-f1a8-4915-97a3-3cb6b82d9923 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:26:43.488234 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-46376eba-f1a8-4915-97a3-3cb6b82d9923 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:26:43.773601 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-46376eba-f1a8-4915-97a3-3cb6b82d9923 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "POST /compute/v2.1/servers/e5d549b4-7eb7-4cdd-90f0-ead23b7df090/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.298894 Nov 22 12:26:43.774226 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 629/1183] 10.222.0.66 () {60 vars in 1322 bytes} [Mon Nov 22 12:26:43 2021] POST /compute/v2.1/servers/e5d549b4-7eb7-4cdd-90f0-ead23b7df090/os-volume_attachments => generated 194 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 12:26:46.319730 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-b35cc51a-8fd7-46c5-8b7f-ba545a73b775 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:26:46.320302 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-b35cc51a-8fd7-46c5-8b7f-ba545a73b775 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] [instance: 10e112a7-d70a-4499-8be4-fd5e4ab3ec17] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:26:46.324583 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [req-65947f8c-93ac-4ee3-bfae-ae63b3b09e8f req-62bc616a-cc0f-4072-9ad8-20858d4ad152 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10e112a7-d70a-4499-8be4-fd5e4ab3ec17", "tag": "c27e22cf-346f-4a81-8e7d-d2418b4df811"}]} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:26:46.326088 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 12:26:46.326088 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: warnings.warn(msg) Nov 22 12:26:46.326497 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-b35cc51a-8fd7-46c5-8b7f-ba545a73b775 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:26:46.326946 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-b35cc51a-8fd7-46c5-8b7f-ba545a73b775 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:26:46.327757 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-b35cc51a-8fd7-46c5-8b7f-ba545a73b775 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:26:46.328167 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-b35cc51a-8fd7-46c5-8b7f-ba545a73b775 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:26:46.333420 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [req-65947f8c-93ac-4ee3-bfae-ae63b3b09e8f req-62bc616a-cc0f-4072-9ad8-20858d4ad152 service nova] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:26:46.334257 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [req-65947f8c-93ac-4ee3-bfae-ae63b3b09e8f req-62bc616a-cc0f-4072-9ad8-20858d4ad152 service nova] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:26:46.345774 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.compute.server_external_events [req-65947f8c-93ac-4ee3-bfae-ae63b3b09e8f req-62bc616a-cc0f-4072-9ad8-20858d4ad152 service nova] Creating event network-changed:c27e22cf-346f-4a81-8e7d-d2418b4df811 for instance 10e112a7-d70a-4499-8be4-fd5e4ab3ec17 on hv-cinder-76845 Nov 22 12:26:46.351068 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [req-65947f8c-93ac-4ee3-bfae-ae63b3b09e8f req-62bc616a-cc0f-4072-9ad8-20858d4ad152 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030854 Nov 22 12:26:46.352025 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 630/1184] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Nov 22 12:26:46 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 22 12:26:46.356228 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-b35cc51a-8fd7-46c5-8b7f-ba545a73b775 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] [instance: 10e112a7-d70a-4499-8be4-fd5e4ab3ec17] Going to try to terminate instance {{(pid=116273) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 22 12:26:46.445130 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-b35cc51a-8fd7-46c5-8b7f-ba545a73b775 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] 10.222.0.66 "DELETE /compute/v2.1/servers/10e112a7-d70a-4499-8be4-fd5e4ab3ec17" status: 204 len: 0 microversion: 2.1 time: 0.127650 Nov 22 12:26:46.448843 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 555/1185] 10.222.0.66 () {58 vars in 1238 bytes} [Mon Nov 22 12:26:46 2021] DELETE /compute/v2.1/servers/10e112a7-d70a-4499-8be4-fd5e4ab3ec17 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 22 12:26:46.454934 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-8b6b53f6-3018-49b1-98eb-61f97e02936d tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:26:46.455668 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-8b6b53f6-3018-49b1-98eb-61f97e02936d tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] [instance: 10e112a7-d70a-4499-8be4-fd5e4ab3ec17] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:26:46.462975 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-8b6b53f6-3018-49b1-98eb-61f97e02936d tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:26:46.463466 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-8b6b53f6-3018-49b1-98eb-61f97e02936d tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:26:46.464276 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-8b6b53f6-3018-49b1-98eb-61f97e02936d tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:26:46.464703 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-8b6b53f6-3018-49b1-98eb-61f97e02936d tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:26:46.692261 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-8b6b53f6-3018-49b1-98eb-61f97e02936d tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c15e2c2fa94be8b638f2257efb5820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575f4ae5262e4930b6658095a1aa8a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:26:46.700482 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-8b6b53f6-3018-49b1-98eb-61f97e02936d tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] 10.222.0.66 "GET /compute/v2.1/servers/10e112a7-d70a-4499-8be4-fd5e4ab3ec17" status: 200 len: 1566 microversion: 2.1 time: 0.250026 Nov 22 12:26:46.709577 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 631/1186] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:26:46 2021] GET /compute/v2.1/servers/10e112a7-d70a-4499-8be4-fd5e4ab3ec17 => generated 1566 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:26:47.718882 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-0546c2ca-1946-42ca-89eb-0eb2bb842c61 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:26:47.719654 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-0546c2ca-1946-42ca-89eb-0eb2bb842c61 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] [instance: 10e112a7-d70a-4499-8be4-fd5e4ab3ec17] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:26:47.726924 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-0546c2ca-1946-42ca-89eb-0eb2bb842c61 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:26:47.727441 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-0546c2ca-1946-42ca-89eb-0eb2bb842c61 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:26:47.728221 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-0546c2ca-1946-42ca-89eb-0eb2bb842c61 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:26:47.728653 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-0546c2ca-1946-42ca-89eb-0eb2bb842c61 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:26:47.888777 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-0546c2ca-1946-42ca-89eb-0eb2bb842c61 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c15e2c2fa94be8b638f2257efb5820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575f4ae5262e4930b6658095a1aa8a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:26:47.899570 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-0546c2ca-1946-42ca-89eb-0eb2bb842c61 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] 10.222.0.66 "GET /compute/v2.1/servers/10e112a7-d70a-4499-8be4-fd5e4ab3ec17" status: 200 len: 1449 microversion: 2.1 time: 0.184739 Nov 22 12:26:47.900148 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 556/1187] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:26:47 2021] GET /compute/v2.1/servers/10e112a7-d70a-4499-8be4-fd5e4ab3ec17 => generated 1449 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:26:48.233102 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-af649b82-62fa-4932-891d-6eef44daea5d tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:26:48.234070 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-af649b82-62fa-4932-891d-6eef44daea5d tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: 496ce05f-ecc0-4dfd-b1d4-1c961f763af7] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:26:48.240566 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-af649b82-62fa-4932-891d-6eef44daea5d tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:26:48.241005 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-af649b82-62fa-4932-891d-6eef44daea5d tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:26:48.241778 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-af649b82-62fa-4932-891d-6eef44daea5d tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:26:48.242312 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-af649b82-62fa-4932-891d-6eef44daea5d tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:26:48.271755 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-af649b82-62fa-4932-891d-6eef44daea5d tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "GET /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.042384 Nov 22 12:26:48.272561 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 632/1188] 10.222.0.66 () {60 vars in 1342 bytes} [Mon Nov 22 12:26:48 2021] GET /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:26:48.335149 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-64d991bb-d872-4f06-8f39-b9cd5aab0f96 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:26:48.335713 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-64d991bb-d872-4f06-8f39-b9cd5aab0f96 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: 496ce05f-ecc0-4dfd-b1d4-1c961f763af7] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:26:48.342115 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-64d991bb-d872-4f06-8f39-b9cd5aab0f96 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:26:48.342558 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-64d991bb-d872-4f06-8f39-b9cd5aab0f96 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:26:48.343363 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-64d991bb-d872-4f06-8f39-b9cd5aab0f96 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:26:48.343795 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-64d991bb-d872-4f06-8f39-b9cd5aab0f96 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:26:48.370725 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-64d991bb-d872-4f06-8f39-b9cd5aab0f96 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: 496ce05f-ecc0-4dfd-b1d4-1c961f763af7] Going to try to terminate instance {{(pid=116273) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 22 12:26:48.453961 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-64d991bb-d872-4f06-8f39-b9cd5aab0f96 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "DELETE /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7" status: 204 len: 0 microversion: 2.20 time: 0.122167 Nov 22 12:26:48.455050 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 557/1189] 10.222.0.66 () {60 vars in 1279 bytes} [Mon Nov 22 12:26:48 2021] DELETE /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 22 12:26:48.463718 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-fd3de52d-4e44-486c-a8f3-f39da9066f2d tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:26:48.464735 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-fd3de52d-4e44-486c-a8f3-f39da9066f2d tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: 496ce05f-ecc0-4dfd-b1d4-1c961f763af7] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:26:48.471334 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-fd3de52d-4e44-486c-a8f3-f39da9066f2d tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:26:48.471776 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-fd3de52d-4e44-486c-a8f3-f39da9066f2d tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:26:48.472585 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-fd3de52d-4e44-486c-a8f3-f39da9066f2d tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:26:48.473011 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-fd3de52d-4e44-486c-a8f3-f39da9066f2d tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:26:48.618596 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [req-9302892d-df23-486d-9c6c-21e88e9d30f1 req-67628a53-5fae-4f26-9b6b-6118d7d71693 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10e112a7-d70a-4499-8be4-fd5e4ab3ec17", "name": "network-vif-deleted", "tag": "c27e22cf-346f-4a81-8e7d-d2418b4df811"}]} {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:26:48.621089 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 12:26:48.621089 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: warnings.warn(msg) Nov 22 12:26:48.629021 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [req-9302892d-df23-486d-9c6c-21e88e9d30f1 req-67628a53-5fae-4f26-9b6b-6118d7d71693 service nova] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:26:48.629465 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [req-9302892d-df23-486d-9c6c-21e88e9d30f1 req-67628a53-5fae-4f26-9b6b-6118d7d71693 service nova] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:26:48.641635 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.compute.server_external_events [req-9302892d-df23-486d-9c6c-21e88e9d30f1 req-67628a53-5fae-4f26-9b6b-6118d7d71693 service nova] Creating event network-vif-deleted:c27e22cf-346f-4a81-8e7d-d2418b4df811 for instance 10e112a7-d70a-4499-8be4-fd5e4ab3ec17 on hv-cinder-76845 Nov 22 12:26:48.646972 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [req-9302892d-df23-486d-9c6c-21e88e9d30f1 req-67628a53-5fae-4f26-9b6b-6118d7d71693 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034298 Nov 22 12:26:48.647858 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 558/1190] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Nov 22 12:26:48 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 22 12:26:48.697561 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-fd3de52d-4e44-486c-a8f3-f39da9066f2d tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:26:48.705378 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-fd3de52d-4e44-486c-a8f3-f39da9066f2d tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:26:48.707097 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-fd3de52d-4e44-486c-a8f3-f39da9066f2d tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:26:48.708311 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-fd3de52d-4e44-486c-a8f3-f39da9066f2d tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "GET /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7" status: 200 len: 1721 microversion: 2.20 time: 0.249140 Nov 22 12:26:48.708873 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 633/1191] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Nov 22 12:26:48 2021] GET /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7 => generated 1721 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 12:26:48.919848 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-3eaedf03-33d2-4eee-ace6-8c3fda791c2f tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:26:48.920761 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-3eaedf03-33d2-4eee-ace6-8c3fda791c2f tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] [instance: 10e112a7-d70a-4499-8be4-fd5e4ab3ec17] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:26:48.927750 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-3eaedf03-33d2-4eee-ace6-8c3fda791c2f tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:26:48.928633 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-3eaedf03-33d2-4eee-ace6-8c3fda791c2f tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:26:48.929705 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-3eaedf03-33d2-4eee-ace6-8c3fda791c2f tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:26:48.930514 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-3eaedf03-33d2-4eee-ace6-8c3fda791c2f tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:26:49.001581 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-3eaedf03-33d2-4eee-ace6-8c3fda791c2f tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67c15e2c2fa94be8b638f2257efb5820', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575f4ae5262e4930b6658095a1aa8a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:26:49.010329 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-3eaedf03-33d2-4eee-ace6-8c3fda791c2f tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] 10.222.0.66 "GET /compute/v2.1/servers/10e112a7-d70a-4499-8be4-fd5e4ab3ec17" status: 200 len: 1218 microversion: 2.1 time: 0.095283 Nov 22 12:26:49.010921 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 559/1192] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:26:48 2021] GET /compute/v2.1/servers/10e112a7-d70a-4499-8be4-fd5e4ab3ec17 => generated 1218 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:26:49.727663 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-9a6e7c35-6bb4-499d-aba2-c3097d9ee71a tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:26:49.728423 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-9a6e7c35-6bb4-499d-aba2-c3097d9ee71a tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: 496ce05f-ecc0-4dfd-b1d4-1c961f763af7] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:26:49.735076 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-9a6e7c35-6bb4-499d-aba2-c3097d9ee71a tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:26:49.735561 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-9a6e7c35-6bb4-499d-aba2-c3097d9ee71a tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:26:49.736362 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-9a6e7c35-6bb4-499d-aba2-c3097d9ee71a tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:26:49.736772 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-9a6e7c35-6bb4-499d-aba2-c3097d9ee71a tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:26:49.877268 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-9a6e7c35-6bb4-499d-aba2-c3097d9ee71a tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:26:49.886196 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-9a6e7c35-6bb4-499d-aba2-c3097d9ee71a tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:26:49.887706 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-9a6e7c35-6bb4-499d-aba2-c3097d9ee71a tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:26:49.888867 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-9a6e7c35-6bb4-499d-aba2-c3097d9ee71a tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "GET /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7" status: 200 len: 1721 microversion: 2.20 time: 0.165828 Nov 22 12:26:49.889429 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 634/1193] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Nov 22 12:26:49 2021] GET /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7 => generated 1721 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 12:26:50.027553 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-46f59fec-ca43-4353-bfc4-482f45dd208c tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:26:50.028544 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-46f59fec-ca43-4353-bfc4-482f45dd208c tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] [instance: 10e112a7-d70a-4499-8be4-fd5e4ab3ec17] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:26:50.035534 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-46f59fec-ca43-4353-bfc4-482f45dd208c tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:26:50.036167 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-46f59fec-ca43-4353-bfc4-482f45dd208c tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:26:50.037059 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-46f59fec-ca43-4353-bfc4-482f45dd208c tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:26:50.037497 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-46f59fec-ca43-4353-bfc4-482f45dd208c tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:26:50.051699 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.wsgi [None req-46f59fec-ca43-4353-bfc4-482f45dd208c tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] HTTP exception thrown: Instance 10e112a7-d70a-4499-8be4-fd5e4ab3ec17 could not be found. Nov 22 12:26:50.052285 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-46f59fec-ca43-4353-bfc4-482f45dd208c tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Returning 404 to user: Instance 10e112a7-d70a-4499-8be4-fd5e4ab3ec17 could not be found. {{(pid=116273) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 12:26:50.053131 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-46f59fec-ca43-4353-bfc4-482f45dd208c tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] 10.222.0.66 "GET /compute/v2.1/servers/10e112a7-d70a-4499-8be4-fd5e4ab3ec17" status: 404 len: 111 microversion: 2.1 time: 0.029435 Nov 22 12:26:50.053682 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 560/1194] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:26:50 2021] GET /compute/v2.1/servers/10e112a7-d70a-4499-8be4-fd5e4ab3ec17 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 22 12:26:50.256446 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-0f3d08cb-2ab9-44e6-b7d0-e9bd61f88f20 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] Calling method '.version_select at 0x7fa1a3d04160>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:26:50.287857 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-0f3d08cb-2ab9-44e6-b7d0-e9bd61f88f20 tempest-TestShelveInstance-855138255 tempest-TestShelveInstance-855138255-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1481680365" status: 202 len: 0 microversion: 2.1 time: 0.035173 Nov 22 12:26:50.289457 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 635/1195] 10.222.0.66 () {58 vars in 1253 bytes} [Mon Nov 22 12:26:50 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1481680365 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 22 12:26:50.907847 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-cfe5d5d0-1970-4e7b-99d3-b9a6807b886b tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:26:50.908661 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-cfe5d5d0-1970-4e7b-99d3-b9a6807b886b tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: 496ce05f-ecc0-4dfd-b1d4-1c961f763af7] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:26:50.916496 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-cfe5d5d0-1970-4e7b-99d3-b9a6807b886b tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:26:50.917086 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-cfe5d5d0-1970-4e7b-99d3-b9a6807b886b tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:26:50.918013 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-cfe5d5d0-1970-4e7b-99d3-b9a6807b886b tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:26:50.918557 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-cfe5d5d0-1970-4e7b-99d3-b9a6807b886b tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:26:51.005221 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-cfe5d5d0-1970-4e7b-99d3-b9a6807b886b tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:26:51.018035 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-cfe5d5d0-1970-4e7b-99d3-b9a6807b886b tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:26:51.021635 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-cfe5d5d0-1970-4e7b-99d3-b9a6807b886b tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '31f429dd496b45b9a9c2c13341cca92f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '086a36bf2fea4df7a4d72733b2f68dcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:26:51.023890 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-cfe5d5d0-1970-4e7b-99d3-b9a6807b886b tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "GET /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7" status: 200 len: 1654 microversion: 2.20 time: 0.119588 Nov 22 12:26:51.024481 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 561/1196] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Nov 22 12:26:50 2021] GET /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7 => generated 1654 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 22 12:26:51.229858 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [req-6ab4ba44-cc18-4f81-8206-7b2ba7ca1f18 req-64d9a5cb-0f30-46a8-ae4a-51f1b2ea4867 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "496ce05f-ecc0-4dfd-b1d4-1c961f763af7", "name": "network-vif-deleted", "tag": "94a1cac1-1361-4086-b60b-55660b9c75fc"}]} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:26:51.231914 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 12:26:51.231914 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: warnings.warn(msg) Nov 22 12:26:51.263223 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [req-6ab4ba44-cc18-4f81-8206-7b2ba7ca1f18 req-64d9a5cb-0f30-46a8-ae4a-51f1b2ea4867 service nova] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:26:51.263693 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [req-6ab4ba44-cc18-4f81-8206-7b2ba7ca1f18 req-64d9a5cb-0f30-46a8-ae4a-51f1b2ea4867 service nova] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:26:51.289616 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.compute.server_external_events [req-6ab4ba44-cc18-4f81-8206-7b2ba7ca1f18 req-64d9a5cb-0f30-46a8-ae4a-51f1b2ea4867 service nova] Creating event network-vif-deleted:94a1cac1-1361-4086-b60b-55660b9c75fc for instance 496ce05f-ecc0-4dfd-b1d4-1c961f763af7 on hv-cinder-76845 Nov 22 12:26:51.306924 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [req-6ab4ba44-cc18-4f81-8206-7b2ba7ca1f18 req-64d9a5cb-0f30-46a8-ae4a-51f1b2ea4867 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081474 Nov 22 12:26:51.309394 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 636/1197] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Nov 22 12:26:51 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 12:26:51.369624 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-c0f3a53a-f3f4-48a5-aa16-066493118369 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:26:51.372761 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-c0f3a53a-f3f4-48a5-aa16-066493118369 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: e5d549b4-7eb7-4cdd-90f0-ead23b7df090] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:26:51.387271 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-c0f3a53a-f3f4-48a5-aa16-066493118369 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:26:51.389151 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-c0f3a53a-f3f4-48a5-aa16-066493118369 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:26:51.390364 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-c0f3a53a-f3f4-48a5-aa16-066493118369 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:26:51.391868 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-c0f3a53a-f3f4-48a5-aa16-066493118369 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:26:51.443925 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-c0f3a53a-f3f4-48a5-aa16-066493118369 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "GET /compute/v2.1/servers/e5d549b4-7eb7-4cdd-90f0-ead23b7df090/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.079272 Nov 22 12:26:51.445834 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 562/1198] 10.222.0.66 () {58 vars in 1301 bytes} [Mon Nov 22 12:26:51 2021] GET /compute/v2.1/servers/e5d549b4-7eb7-4cdd-90f0-ead23b7df090/os-volume_attachments => generated 371 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 12:26:51.714616 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-0bf77d63-6914-4b4d-ab21-c24807687d70 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:26:51.715575 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-0bf77d63-6914-4b4d-ab21-c24807687d70 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: e5d549b4-7eb7-4cdd-90f0-ead23b7df090] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:26:51.724796 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-0bf77d63-6914-4b4d-ab21-c24807687d70 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:26:51.725250 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-0bf77d63-6914-4b4d-ab21-c24807687d70 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:26:51.726050 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-0bf77d63-6914-4b4d-ab21-c24807687d70 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:26:51.727449 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-0bf77d63-6914-4b4d-ab21-c24807687d70 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:26:51.780944 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-0bf77d63-6914-4b4d-ab21-c24807687d70 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "GET /compute/v2.1/servers/e5d549b4-7eb7-4cdd-90f0-ead23b7df090/os-volume_attachments/70fe6365-2233-4740-8adf-8d1e91d87e9b" status: 200 len: 194 microversion: 2.1 time: 0.071032 Nov 22 12:26:51.782955 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 637/1199] 10.222.0.66 () {58 vars in 1412 bytes} [Mon Nov 22 12:26:51 2021] GET /compute/v2.1/servers/e5d549b4-7eb7-4cdd-90f0-ead23b7df090/os-volume_attachments/70fe6365-2233-4740-8adf-8d1e91d87e9b => generated 194 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 12:26:51.793722 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-88115e46-864a-4354-81fd-079e6ed4e6ae tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:26:51.794260 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-88115e46-864a-4354-81fd-079e6ed4e6ae tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: e5d549b4-7eb7-4cdd-90f0-ead23b7df090] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:26:51.801585 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-88115e46-864a-4354-81fd-079e6ed4e6ae tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:26:51.802482 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-88115e46-864a-4354-81fd-079e6ed4e6ae tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:26:51.803961 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-88115e46-864a-4354-81fd-079e6ed4e6ae tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:26:51.805004 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-88115e46-864a-4354-81fd-079e6ed4e6ae tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:26:51.912766 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.objects.instance [None req-88115e46-864a-4354-81fd-079e6ed4e6ae tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lazy-loading 'services' on Instance uuid e5d549b4-7eb7-4cdd-90f0-ead23b7df090 {{(pid=116273) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 22 12:26:52.002192 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-88115e46-864a-4354-81fd-079e6ed4e6ae tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "DELETE /compute/v2.1/servers/e5d549b4-7eb7-4cdd-90f0-ead23b7df090/os-volume_attachments/70fe6365-2233-4740-8adf-8d1e91d87e9b" status: 202 len: 0 microversion: 2.1 time: 0.213754 Nov 22 12:26:52.003288 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 563/1200] 10.222.0.66 () {58 vars in 1415 bytes} [Mon Nov 22 12:26:51 2021] DELETE /compute/v2.1/servers/e5d549b4-7eb7-4cdd-90f0-ead23b7df090/os-volume_attachments/70fe6365-2233-4740-8adf-8d1e91d87e9b => generated 0 bytes in 216 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 22 12:26:52.052543 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-3735371b-fa25-48c9-b3cd-9e13ce6810f0 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:26:52.053175 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-3735371b-fa25-48c9-b3cd-9e13ce6810f0 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: 496ce05f-ecc0-4dfd-b1d4-1c961f763af7] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:26:52.065438 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-3735371b-fa25-48c9-b3cd-9e13ce6810f0 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:26:52.066371 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-3735371b-fa25-48c9-b3cd-9e13ce6810f0 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:26:52.068201 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-3735371b-fa25-48c9-b3cd-9e13ce6810f0 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:26:52.068646 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-3735371b-fa25-48c9-b3cd-9e13ce6810f0 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:26:52.087544 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.wsgi [None req-3735371b-fa25-48c9-b3cd-9e13ce6810f0 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] HTTP exception thrown: Instance 496ce05f-ecc0-4dfd-b1d4-1c961f763af7 could not be found. Nov 22 12:26:52.088435 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-3735371b-fa25-48c9-b3cd-9e13ce6810f0 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Returning 404 to user: Instance 496ce05f-ecc0-4dfd-b1d4-1c961f763af7 could not be found. {{(pid=116272) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 12:26:52.089449 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-3735371b-fa25-48c9-b3cd-9e13ce6810f0 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "GET /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7" status: 404 len: 111 microversion: 2.20 time: 0.040983 Nov 22 12:26:52.090222 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 638/1201] 10.222.0.66 () {60 vars in 1276 bytes} [Mon Nov 22 12:26:52 2021] GET /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 22 12:26:52.099954 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-4a1e27b8-95a2-48ce-b7eb-846891ba13e6 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Calling method '.version_select at 0x7fa1ac301700>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:26:52.128292 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-4a1e27b8-95a2-48ce-b7eb-846891ba13e6 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1813873829" status: 204 len: 0 microversion: 2.20 time: 0.032588 Nov 22 12:26:52.129502 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 564/1202] 10.222.0.66 () {60 vars in 1261 bytes} [Mon Nov 22 12:26:52 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1813873829 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 22 12:26:53.134513 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-ec09e1ce-4ad1-40a8-98ed-e0b672034dbe tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:26:53.135409 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-ec09e1ce-4ad1-40a8-98ed-e0b672034dbe tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: e5d549b4-7eb7-4cdd-90f0-ead23b7df090] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:26:53.141756 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-ec09e1ce-4ad1-40a8-98ed-e0b672034dbe tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:26:53.142204 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-ec09e1ce-4ad1-40a8-98ed-e0b672034dbe tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:26:53.143331 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-ec09e1ce-4ad1-40a8-98ed-e0b672034dbe tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:26:53.143802 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-ec09e1ce-4ad1-40a8-98ed-e0b672034dbe tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:26:53.175245 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-ec09e1ce-4ad1-40a8-98ed-e0b672034dbe tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "GET /compute/v2.1/servers/e5d549b4-7eb7-4cdd-90f0-ead23b7df090/os-volume_attachments/36203589-b05e-462f-96dd-101411080ff2" status: 200 len: 194 microversion: 2.1 time: 0.044688 Nov 22 12:26:53.175783 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 639/1203] 10.222.0.66 () {58 vars in 1412 bytes} [Mon Nov 22 12:26:53 2021] GET /compute/v2.1/servers/e5d549b4-7eb7-4cdd-90f0-ead23b7df090/os-volume_attachments/36203589-b05e-462f-96dd-101411080ff2 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 12:26:53.188422 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-f64be1c0-b80d-4747-99e2-cbfaef31b70b tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:26:53.189165 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-f64be1c0-b80d-4747-99e2-cbfaef31b70b tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: e5d549b4-7eb7-4cdd-90f0-ead23b7df090] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:26:53.197203 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-f64be1c0-b80d-4747-99e2-cbfaef31b70b tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:26:53.197669 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-f64be1c0-b80d-4747-99e2-cbfaef31b70b tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:26:53.198636 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-f64be1c0-b80d-4747-99e2-cbfaef31b70b tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:26:53.199082 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-f64be1c0-b80d-4747-99e2-cbfaef31b70b tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:26:53.308748 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.objects.instance [None req-f64be1c0-b80d-4747-99e2-cbfaef31b70b tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lazy-loading 'services' on Instance uuid e5d549b4-7eb7-4cdd-90f0-ead23b7df090 {{(pid=116273) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 22 12:26:53.420055 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-f64be1c0-b80d-4747-99e2-cbfaef31b70b tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "DELETE /compute/v2.1/servers/e5d549b4-7eb7-4cdd-90f0-ead23b7df090/os-volume_attachments/36203589-b05e-462f-96dd-101411080ff2" status: 202 len: 0 microversion: 2.1 time: 0.237083 Nov 22 12:26:53.421324 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 565/1204] 10.222.0.66 () {58 vars in 1415 bytes} [Mon Nov 22 12:26:53 2021] DELETE /compute/v2.1/servers/e5d549b4-7eb7-4cdd-90f0-ead23b7df090/os-volume_attachments/36203589-b05e-462f-96dd-101411080ff2 => generated 0 bytes in 240 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 22 12:26:54.142972 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-4224859a-707c-4be3-9098-984f6ab75467 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:26:54.144160 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-4224859a-707c-4be3-9098-984f6ab75467 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: 496ce05f-ecc0-4dfd-b1d4-1c961f763af7] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:26:54.156378 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-4224859a-707c-4be3-9098-984f6ab75467 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:26:54.157605 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-4224859a-707c-4be3-9098-984f6ab75467 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:26:54.160430 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-4224859a-707c-4be3-9098-984f6ab75467 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:26:54.161721 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-4224859a-707c-4be3-9098-984f6ab75467 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:26:54.184090 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.wsgi [None req-4224859a-707c-4be3-9098-984f6ab75467 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] HTTP exception thrown: Instance 496ce05f-ecc0-4dfd-b1d4-1c961f763af7 could not be found. Nov 22 12:26:54.189370 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-4224859a-707c-4be3-9098-984f6ab75467 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Returning 404 to user: Instance 496ce05f-ecc0-4dfd-b1d4-1c961f763af7 could not be found. {{(pid=116272) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 12:26:54.190636 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-4224859a-707c-4be3-9098-984f6ab75467 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "DELETE /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7" status: 404 len: 111 microversion: 2.1 time: 0.053084 Nov 22 12:26:54.191406 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 640/1205] 10.222.0.66 () {58 vars in 1238 bytes} [Mon Nov 22 12:26:54 2021] DELETE /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 22 12:26:54.201687 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-6ea647f4-1812-4560-9bde-3b8f9ddb0143 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:26:54.203063 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-6ea647f4-1812-4560-9bde-3b8f9ddb0143 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: 496ce05f-ecc0-4dfd-b1d4-1c961f763af7] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:26:54.211690 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-6ea647f4-1812-4560-9bde-3b8f9ddb0143 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:26:54.212463 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-6ea647f4-1812-4560-9bde-3b8f9ddb0143 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:26:54.213501 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-6ea647f4-1812-4560-9bde-3b8f9ddb0143 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:26:54.214128 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-6ea647f4-1812-4560-9bde-3b8f9ddb0143 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:26:54.228518 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.wsgi [None req-6ea647f4-1812-4560-9bde-3b8f9ddb0143 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] HTTP exception thrown: Instance 496ce05f-ecc0-4dfd-b1d4-1c961f763af7 could not be found. Nov 22 12:26:54.229427 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-6ea647f4-1812-4560-9bde-3b8f9ddb0143 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Returning 404 to user: Instance 496ce05f-ecc0-4dfd-b1d4-1c961f763af7 could not be found. {{(pid=116273) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 12:26:54.230431 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-6ea647f4-1812-4560-9bde-3b8f9ddb0143 tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "GET /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7" status: 404 len: 111 microversion: 2.1 time: 0.033490 Nov 22 12:26:54.230988 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 566/1206] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:26:54 2021] GET /compute/v2.1/servers/496ce05f-ecc0-4dfd-b1d4-1c961f763af7 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 22 12:26:54.593171 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-febb2d28-e5e3-4a7b-a80f-971eaaf84a51 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:26:54.594094 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-febb2d28-e5e3-4a7b-a80f-971eaaf84a51 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: e5d549b4-7eb7-4cdd-90f0-ead23b7df090] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:26:54.600083 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-febb2d28-e5e3-4a7b-a80f-971eaaf84a51 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:26:54.600478 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-febb2d28-e5e3-4a7b-a80f-971eaaf84a51 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:26:54.601292 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-febb2d28-e5e3-4a7b-a80f-971eaaf84a51 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:26:54.601732 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-febb2d28-e5e3-4a7b-a80f-971eaaf84a51 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:26:54.632009 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-febb2d28-e5e3-4a7b-a80f-971eaaf84a51 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "GET /compute/v2.1/servers/e5d549b4-7eb7-4cdd-90f0-ead23b7df090/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042535 Nov 22 12:26:54.632513 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 641/1207] 10.222.0.66 () {58 vars in 1301 bytes} [Mon Nov 22 12:26:54 2021] GET /compute/v2.1/servers/e5d549b4-7eb7-4cdd-90f0-ead23b7df090/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 22 12:26:54.735991 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-26926bfe-9daf-47e8-aa37-ad68e545e0b6 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:26:54.736928 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-26926bfe-9daf-47e8-aa37-ad68e545e0b6 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: e5d549b4-7eb7-4cdd-90f0-ead23b7df090] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:26:54.743284 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-26926bfe-9daf-47e8-aa37-ad68e545e0b6 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:26:54.743786 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-26926bfe-9daf-47e8-aa37-ad68e545e0b6 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:26:54.744528 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-26926bfe-9daf-47e8-aa37-ad68e545e0b6 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:26:54.745008 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-26926bfe-9daf-47e8-aa37-ad68e545e0b6 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:26:54.775156 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-26926bfe-9daf-47e8-aa37-ad68e545e0b6 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "GET /compute/v2.1/servers/e5d549b4-7eb7-4cdd-90f0-ead23b7df090/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043087 Nov 22 12:26:54.775781 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 567/1208] 10.222.0.66 () {58 vars in 1301 bytes} [Mon Nov 22 12:26:54 2021] GET /compute/v2.1/servers/e5d549b4-7eb7-4cdd-90f0-ead23b7df090/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 22 12:26:54.837067 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-af5d41bf-44a9-4c3f-a786-b3927e210533 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:26:54.837565 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-af5d41bf-44a9-4c3f-a786-b3927e210533 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: e5d549b4-7eb7-4cdd-90f0-ead23b7df090] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:26:54.843875 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-af5d41bf-44a9-4c3f-a786-b3927e210533 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:26:54.844358 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-af5d41bf-44a9-4c3f-a786-b3927e210533 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:26:54.845152 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-af5d41bf-44a9-4c3f-a786-b3927e210533 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:26:54.845591 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-af5d41bf-44a9-4c3f-a786-b3927e210533 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:26:54.870805 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-af5d41bf-44a9-4c3f-a786-b3927e210533 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: e5d549b4-7eb7-4cdd-90f0-ead23b7df090] Going to try to terminate instance {{(pid=116272) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 22 12:26:54.959598 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-af5d41bf-44a9-4c3f-a786-b3927e210533 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "DELETE /compute/v2.1/servers/e5d549b4-7eb7-4cdd-90f0-ead23b7df090" status: 204 len: 0 microversion: 2.1 time: 0.126286 Nov 22 12:26:54.964025 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 642/1209] 10.222.0.66 () {58 vars in 1238 bytes} [Mon Nov 22 12:26:54 2021] DELETE /compute/v2.1/servers/e5d549b4-7eb7-4cdd-90f0-ead23b7df090 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 22 12:26:54.969071 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-d88f39ad-b29e-4eb3-b521-19080df2e952 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:26:54.969794 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-d88f39ad-b29e-4eb3-b521-19080df2e952 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: e5d549b4-7eb7-4cdd-90f0-ead23b7df090] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:26:54.976623 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-d88f39ad-b29e-4eb3-b521-19080df2e952 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:26:54.977162 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-d88f39ad-b29e-4eb3-b521-19080df2e952 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:26:54.978046 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-d88f39ad-b29e-4eb3-b521-19080df2e952 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:26:54.978715 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-d88f39ad-b29e-4eb3-b521-19080df2e952 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:26:55.206422 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-d88f39ad-b29e-4eb3-b521-19080df2e952 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41d885b9b854d8db11da5d325552301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f5dffe9bc3f41c7a2656d194fd02173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:26:55.214795 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-d88f39ad-b29e-4eb3-b521-19080df2e952 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "GET /compute/v2.1/servers/e5d549b4-7eb7-4cdd-90f0-ead23b7df090" status: 200 len: 1673 microversion: 2.1 time: 0.249499 Nov 22 12:26:55.215367 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 568/1210] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:26:54 2021] GET /compute/v2.1/servers/e5d549b4-7eb7-4cdd-90f0-ead23b7df090 => generated 1673 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:26:55.386287 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-8e5af8f8-d27c-4708-b388-b98b9ed81d0d tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:26:55.387112 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-8e5af8f8-d27c-4708-b388-b98b9ed81d0d tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: c9f6d441-246f-479e-8e88-ea701c0f87ff] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:26:55.393566 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-8e5af8f8-d27c-4708-b388-b98b9ed81d0d tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:26:55.394015 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-8e5af8f8-d27c-4708-b388-b98b9ed81d0d tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:26:55.394829 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-8e5af8f8-d27c-4708-b388-b98b9ed81d0d tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:26:55.395263 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-8e5af8f8-d27c-4708-b388-b98b9ed81d0d tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:26:55.410098 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.wsgi [None req-8e5af8f8-d27c-4708-b388-b98b9ed81d0d tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] HTTP exception thrown: Instance c9f6d441-246f-479e-8e88-ea701c0f87ff could not be found. Nov 22 12:26:55.410690 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-8e5af8f8-d27c-4708-b388-b98b9ed81d0d tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Returning 404 to user: Instance c9f6d441-246f-479e-8e88-ea701c0f87ff could not be found. {{(pid=116272) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 12:26:55.411541 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-8e5af8f8-d27c-4708-b388-b98b9ed81d0d tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "DELETE /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff" status: 404 len: 111 microversion: 2.1 time: 0.030283 Nov 22 12:26:55.412341 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 643/1211] 10.222.0.66 () {58 vars in 1238 bytes} [Mon Nov 22 12:26:55 2021] DELETE /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 22 12:26:55.422813 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-b44498bb-7909-4336-8473-2c6d1ac9fc5c tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:26:55.423464 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-b44498bb-7909-4336-8473-2c6d1ac9fc5c tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] [instance: c9f6d441-246f-479e-8e88-ea701c0f87ff] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:26:55.430566 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-b44498bb-7909-4336-8473-2c6d1ac9fc5c tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:26:55.431114 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-b44498bb-7909-4336-8473-2c6d1ac9fc5c tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:26:55.431854 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-b44498bb-7909-4336-8473-2c6d1ac9fc5c tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:26:55.432285 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-b44498bb-7909-4336-8473-2c6d1ac9fc5c tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:26:55.449030 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.wsgi [None req-b44498bb-7909-4336-8473-2c6d1ac9fc5c tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] HTTP exception thrown: Instance c9f6d441-246f-479e-8e88-ea701c0f87ff could not be found. Nov 22 12:26:55.449630 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-b44498bb-7909-4336-8473-2c6d1ac9fc5c tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] Returning 404 to user: Instance c9f6d441-246f-479e-8e88-ea701c0f87ff could not be found. {{(pid=116273) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 12:26:55.450647 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-b44498bb-7909-4336-8473-2c6d1ac9fc5c tempest-AttachVolumeShelveTestJSON-1293954511 tempest-AttachVolumeShelveTestJSON-1293954511-project] 10.222.0.66 "GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff" status: 404 len: 111 microversion: 2.1 time: 0.033274 Nov 22 12:26:55.451203 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 569/1212] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:26:55 2021] GET /compute/v2.1/servers/c9f6d441-246f-479e-8e88-ea701c0f87ff => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 22 12:26:56.232211 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-0a551844-a5a6-480b-b886-bbdf056379e0 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:26:56.232818 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-0a551844-a5a6-480b-b886-bbdf056379e0 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: e5d549b4-7eb7-4cdd-90f0-ead23b7df090] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:26:56.239385 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-0a551844-a5a6-480b-b886-bbdf056379e0 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:26:56.239839 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-0a551844-a5a6-480b-b886-bbdf056379e0 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:26:56.240653 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-0a551844-a5a6-480b-b886-bbdf056379e0 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:26:56.241059 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-0a551844-a5a6-480b-b886-bbdf056379e0 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:26:56.653766 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-0a551844-a5a6-480b-b886-bbdf056379e0 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41d885b9b854d8db11da5d325552301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f5dffe9bc3f41c7a2656d194fd02173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:26:56.669389 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-0a551844-a5a6-480b-b886-bbdf056379e0 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "GET /compute/v2.1/servers/e5d549b4-7eb7-4cdd-90f0-ead23b7df090" status: 200 len: 1673 microversion: 2.1 time: 0.440780 Nov 22 12:26:56.670625 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 644/1213] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:26:56 2021] GET /compute/v2.1/servers/e5d549b4-7eb7-4cdd-90f0-ead23b7df090 => generated 1673 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:26:57.687092 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-0355e1c9-0d45-47d7-8264-7a43e5b8339c tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:26:57.687674 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-0355e1c9-0d45-47d7-8264-7a43e5b8339c tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: e5d549b4-7eb7-4cdd-90f0-ead23b7df090] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:26:57.694169 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-0355e1c9-0d45-47d7-8264-7a43e5b8339c tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:26:57.694626 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-0355e1c9-0d45-47d7-8264-7a43e5b8339c tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:26:57.695526 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-0355e1c9-0d45-47d7-8264-7a43e5b8339c tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:26:57.695962 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-0355e1c9-0d45-47d7-8264-7a43e5b8339c tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:26:57.819098 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-0355e1c9-0d45-47d7-8264-7a43e5b8339c tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41d885b9b854d8db11da5d325552301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f5dffe9bc3f41c7a2656d194fd02173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:26:57.831063 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-0355e1c9-0d45-47d7-8264-7a43e5b8339c tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "GET /compute/v2.1/servers/e5d549b4-7eb7-4cdd-90f0-ead23b7df090" status: 200 len: 1605 microversion: 2.1 time: 0.147688 Nov 22 12:26:57.831937 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 570/1214] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:26:57 2021] GET /compute/v2.1/servers/e5d549b4-7eb7-4cdd-90f0-ead23b7df090 => generated 1605 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:26:58.730702 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [req-1b0ba563-dfa5-4426-8f79-6ed6f719314f req-68ab75e2-1cb5-4a6f-82ec-cb4fcf45f729 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5d549b4-7eb7-4cdd-90f0-ead23b7df090", "name": "network-vif-deleted", "tag": "cdf642d5-e9c9-4450-b020-77cb141c2767"}]} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:26:58.732264 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 12:26:58.732264 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: warnings.warn(msg) Nov 22 12:26:58.751474 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [req-1b0ba563-dfa5-4426-8f79-6ed6f719314f req-68ab75e2-1cb5-4a6f-82ec-cb4fcf45f729 service nova] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:26:58.751919 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [req-1b0ba563-dfa5-4426-8f79-6ed6f719314f req-68ab75e2-1cb5-4a6f-82ec-cb4fcf45f729 service nova] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:26:58.764390 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.compute.server_external_events [req-1b0ba563-dfa5-4426-8f79-6ed6f719314f req-68ab75e2-1cb5-4a6f-82ec-cb4fcf45f729 service nova] Creating event network-vif-deleted:cdf642d5-e9c9-4450-b020-77cb141c2767 for instance e5d549b4-7eb7-4cdd-90f0-ead23b7df090 on hv-cinder-76845 Nov 22 12:26:58.769528 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [req-1b0ba563-dfa5-4426-8f79-6ed6f719314f req-68ab75e2-1cb5-4a6f-82ec-cb4fcf45f729 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043359 Nov 22 12:26:58.770348 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 645/1215] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Nov 22 12:26:58 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 12:26:58.849738 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-a67d6e33-ecc5-45eb-ba7e-9bdb46564f8b tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:26:58.851007 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-a67d6e33-ecc5-45eb-ba7e-9bdb46564f8b tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: e5d549b4-7eb7-4cdd-90f0-ead23b7df090] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:26:58.857960 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-a67d6e33-ecc5-45eb-ba7e-9bdb46564f8b tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:26:58.858416 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-a67d6e33-ecc5-45eb-ba7e-9bdb46564f8b tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:26:58.859211 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-a67d6e33-ecc5-45eb-ba7e-9bdb46564f8b tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:26:58.859677 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-a67d6e33-ecc5-45eb-ba7e-9bdb46564f8b tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:26:58.896133 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-a67d6e33-ecc5-45eb-ba7e-9bdb46564f8b tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:26:58.896612 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-a67d6e33-ecc5-45eb-ba7e-9bdb46564f8b tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:26:58.897090 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.objects.instance [None req-a67d6e33-ecc5-45eb-ba7e-9bdb46564f8b tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lazy-loading 'fault' on Instance uuid e5d549b4-7eb7-4cdd-90f0-ead23b7df090 {{(pid=116273) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 22 12:26:58.974158 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-a67d6e33-ecc5-45eb-ba7e-9bdb46564f8b tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b41d885b9b854d8db11da5d325552301', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f5dffe9bc3f41c7a2656d194fd02173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:26:58.983392 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-a67d6e33-ecc5-45eb-ba7e-9bdb46564f8b tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "GET /compute/v2.1/servers/e5d549b4-7eb7-4cdd-90f0-ead23b7df090" status: 200 len: 1327 microversion: 2.1 time: 0.137943 Nov 22 12:26:58.984376 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 571/1216] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:26:58 2021] GET /compute/v2.1/servers/e5d549b4-7eb7-4cdd-90f0-ead23b7df090 => generated 1327 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:27:00.002113 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-207ed755-5e5c-4170-a97a-08bce2c1ab5e tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:27:00.003573 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-207ed755-5e5c-4170-a97a-08bce2c1ab5e tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: e5d549b4-7eb7-4cdd-90f0-ead23b7df090] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:27:00.010667 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-207ed755-5e5c-4170-a97a-08bce2c1ab5e tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:27:00.011212 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-207ed755-5e5c-4170-a97a-08bce2c1ab5e tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:27:00.013150 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-207ed755-5e5c-4170-a97a-08bce2c1ab5e tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:27:00.013918 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-207ed755-5e5c-4170-a97a-08bce2c1ab5e tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:27:00.030394 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.wsgi [None req-207ed755-5e5c-4170-a97a-08bce2c1ab5e tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] HTTP exception thrown: Instance e5d549b4-7eb7-4cdd-90f0-ead23b7df090 could not be found. Nov 22 12:27:00.031130 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-207ed755-5e5c-4170-a97a-08bce2c1ab5e tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Returning 404 to user: Instance e5d549b4-7eb7-4cdd-90f0-ead23b7df090 could not be found. {{(pid=116272) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 12:27:00.032094 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-207ed755-5e5c-4170-a97a-08bce2c1ab5e tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "GET /compute/v2.1/servers/e5d549b4-7eb7-4cdd-90f0-ead23b7df090" status: 404 len: 111 microversion: 2.1 time: 0.033993 Nov 22 12:27:00.032903 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 646/1217] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:26:59 2021] GET /compute/v2.1/servers/e5d549b4-7eb7-4cdd-90f0-ead23b7df090 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 22 12:27:00.041548 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-42d77923-992b-4cdd-84e1-90ca76d4cd7c tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Calling method '.version_select at 0x7fa1ac37fa60>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:27:00.061460 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-42d77923-992b-4cdd-84e1-90ca76d4cd7c tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-265908318" status: 202 len: 0 microversion: 2.1 time: 0.023662 Nov 22 12:27:00.062288 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 572/1218] 10.222.0.66 () {58 vars in 1217 bytes} [Mon Nov 22 12:27:00 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-265908318 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 22 12:27:02.759542 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-d5c6ca39-757f-43e2-a137-48a6bdd73376 tempest-VolumesGetTestJSON-661067514 tempest-VolumesGetTestJSON-661067514-project] Action: 'create', calling method: .version_select at 0x7fa1ac40a5e0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1045894957", "metadata": {"Type": "work"}}} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:27:03.200016 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-d5c6ca39-757f-43e2-a137-48a6bdd73376 tempest-VolumesGetTestJSON-661067514 tempest-VolumesGetTestJSON-661067514-project] 10.222.0.66 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.568578 Nov 22 12:27:03.201572 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 647/1219] 10.222.0.66 () {60 vars in 1155 bytes} [Mon Nov 22 12:27:02 2021] POST /compute/v2.1/os-volumes => generated 353 bytes in 571 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Nov 22 12:27:03.213537 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-2bfcdadf-c66c-47bc-aa99-b1ca49bfcd95 tempest-VolumesGetTestJSON-661067514 tempest-VolumesGetTestJSON-661067514-project] Calling method '.version_select at 0x7fa1ac2b11f0>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:27:03.278984 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-2bfcdadf-c66c-47bc-aa99-b1ca49bfcd95 tempest-VolumesGetTestJSON-661067514 tempest-VolumesGetTestJSON-661067514-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/e608cd69-aadb-4020-b471-421594df1d2b" status: 200 len: 353 microversion: 2.1 time: 0.070499 Nov 22 12:27:03.279601 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 573/1220] 10.222.0.66 () {58 vars in 1244 bytes} [Mon Nov 22 12:27:03 2021] GET /compute/v2.1/os-volumes/e608cd69-aadb-4020-b471-421594df1d2b => generated 353 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 12:27:03.496464 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-03fa2d0e-71f6-4ff8-805b-b7a13e44d99d tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:27:03.497247 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-03fa2d0e-71f6-4ff8-805b-b7a13e44d99d tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: e5d549b4-7eb7-4cdd-90f0-ead23b7df090] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:27:03.508731 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-03fa2d0e-71f6-4ff8-805b-b7a13e44d99d tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:27:03.509459 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-03fa2d0e-71f6-4ff8-805b-b7a13e44d99d tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:27:03.511061 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-03fa2d0e-71f6-4ff8-805b-b7a13e44d99d tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:27:03.511547 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-03fa2d0e-71f6-4ff8-805b-b7a13e44d99d tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:27:03.528888 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.wsgi [None req-03fa2d0e-71f6-4ff8-805b-b7a13e44d99d tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] HTTP exception thrown: Instance e5d549b4-7eb7-4cdd-90f0-ead23b7df090 could not be found. Nov 22 12:27:03.529499 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-03fa2d0e-71f6-4ff8-805b-b7a13e44d99d tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Returning 404 to user: Instance e5d549b4-7eb7-4cdd-90f0-ead23b7df090 could not be found. {{(pid=116272) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 12:27:03.530332 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-03fa2d0e-71f6-4ff8-805b-b7a13e44d99d tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "DELETE /compute/v2.1/servers/e5d549b4-7eb7-4cdd-90f0-ead23b7df090" status: 404 len: 111 microversion: 2.1 time: 0.047167 Nov 22 12:27:03.531072 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 648/1221] 10.222.0.66 () {58 vars in 1238 bytes} [Mon Nov 22 12:27:03 2021] DELETE /compute/v2.1/servers/e5d549b4-7eb7-4cdd-90f0-ead23b7df090 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 22 12:27:03.539782 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-e3b4e9cf-491d-4181-b716-3d8aa89ba3f8 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:27:03.540770 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-e3b4e9cf-491d-4181-b716-3d8aa89ba3f8 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: e5d549b4-7eb7-4cdd-90f0-ead23b7df090] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:27:03.547617 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-e3b4e9cf-491d-4181-b716-3d8aa89ba3f8 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:27:03.548073 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-e3b4e9cf-491d-4181-b716-3d8aa89ba3f8 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:27:03.548874 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-e3b4e9cf-491d-4181-b716-3d8aa89ba3f8 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:27:03.549496 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-e3b4e9cf-491d-4181-b716-3d8aa89ba3f8 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:27:03.564685 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.wsgi [None req-e3b4e9cf-491d-4181-b716-3d8aa89ba3f8 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] HTTP exception thrown: Instance e5d549b4-7eb7-4cdd-90f0-ead23b7df090 could not be found. Nov 22 12:27:03.565205 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-e3b4e9cf-491d-4181-b716-3d8aa89ba3f8 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Returning 404 to user: Instance e5d549b4-7eb7-4cdd-90f0-ead23b7df090 could not be found. {{(pid=116273) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 12:27:03.566042 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-e3b4e9cf-491d-4181-b716-3d8aa89ba3f8 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "GET /compute/v2.1/servers/e5d549b4-7eb7-4cdd-90f0-ead23b7df090" status: 404 len: 111 microversion: 2.1 time: 0.030633 Nov 22 12:27:03.566592 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 574/1222] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:27:03 2021] GET /compute/v2.1/servers/e5d549b4-7eb7-4cdd-90f0-ead23b7df090 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 22 12:27:04.291764 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-8a606ad8-c9fa-4692-90fb-787bcfeb5d32 tempest-VolumesGetTestJSON-661067514 tempest-VolumesGetTestJSON-661067514-project] Calling method '.version_select at 0x7fa1a331aee0>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:27:04.356200 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-8a606ad8-c9fa-4692-90fb-787bcfeb5d32 tempest-VolumesGetTestJSON-661067514 tempest-VolumesGetTestJSON-661067514-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/e608cd69-aadb-4020-b471-421594df1d2b" status: 200 len: 354 microversion: 2.1 time: 0.068237 Nov 22 12:27:04.363365 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 649/1223] 10.222.0.66 () {58 vars in 1244 bytes} [Mon Nov 22 12:27:04 2021] GET /compute/v2.1/os-volumes/e608cd69-aadb-4020-b471-421594df1d2b => generated 354 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 12:27:04.369689 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-f4e338d1-1eab-4fc3-9a01-3f02aff0201d tempest-VolumesGetTestJSON-661067514 tempest-VolumesGetTestJSON-661067514-project] Calling method '.version_select at 0x7fa1a333b310>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:27:04.432091 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-f4e338d1-1eab-4fc3-9a01-3f02aff0201d tempest-VolumesGetTestJSON-661067514 tempest-VolumesGetTestJSON-661067514-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/e608cd69-aadb-4020-b471-421594df1d2b" status: 200 len: 354 microversion: 2.1 time: 0.066882 Nov 22 12:27:04.432772 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 575/1224] 10.222.0.66 () {58 vars in 1244 bytes} [Mon Nov 22 12:27:04 2021] GET /compute/v2.1/os-volumes/e608cd69-aadb-4020-b471-421594df1d2b => generated 354 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 12:27:04.449920 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-ae204c7a-2cd8-476c-9c6e-58d99d672e0c tempest-VolumesGetTestJSON-661067514 tempest-VolumesGetTestJSON-661067514-project] Calling method '.version_select at 0x7fa1a3d9f790>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:27:04.524511 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-ae204c7a-2cd8-476c-9c6e-58d99d672e0c tempest-VolumesGetTestJSON-661067514 tempest-VolumesGetTestJSON-661067514-project] 10.222.0.66 "DELETE /compute/v2.1/os-volumes/e608cd69-aadb-4020-b471-421594df1d2b" status: 202 len: 0 microversion: 2.1 time: 0.078677 Nov 22 12:27:04.525799 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 650/1225] 10.222.0.66 () {58 vars in 1247 bytes} [Mon Nov 22 12:27:04 2021] DELETE /compute/v2.1/os-volumes/e608cd69-aadb-4020-b471-421594df1d2b => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 22 12:27:04.534907 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-94307306-67b5-4d44-9cb0-29eb1bbd37ba tempest-VolumesGetTestJSON-661067514 tempest-VolumesGetTestJSON-661067514-project] Calling method '.version_select at 0x7fa1ac3495e0>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:27:04.590906 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-94307306-67b5-4d44-9cb0-29eb1bbd37ba tempest-VolumesGetTestJSON-661067514 tempest-VolumesGetTestJSON-661067514-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/e608cd69-aadb-4020-b471-421594df1d2b" status: 200 len: 353 microversion: 2.1 time: 0.060358 Nov 22 12:27:04.591504 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 576/1226] 10.222.0.66 () {58 vars in 1244 bytes} [Mon Nov 22 12:27:04 2021] GET /compute/v2.1/os-volumes/e608cd69-aadb-4020-b471-421594df1d2b => generated 353 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 12:27:04.712996 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-7d2c1f64-17da-4565-97cb-cafe4ddd1093 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:27:04.713750 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-7d2c1f64-17da-4565-97cb-cafe4ddd1093 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: 2306113c-8f98-42fd-8c0c-3dfac98fff21] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:27:04.724104 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-7d2c1f64-17da-4565-97cb-cafe4ddd1093 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:27:04.724894 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-7d2c1f64-17da-4565-97cb-cafe4ddd1093 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:27:04.726150 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-7d2c1f64-17da-4565-97cb-cafe4ddd1093 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:27:04.727037 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-7d2c1f64-17da-4565-97cb-cafe4ddd1093 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:27:04.741350 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.wsgi [None req-7d2c1f64-17da-4565-97cb-cafe4ddd1093 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] HTTP exception thrown: Instance 2306113c-8f98-42fd-8c0c-3dfac98fff21 could not be found. Nov 22 12:27:04.742896 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-7d2c1f64-17da-4565-97cb-cafe4ddd1093 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Returning 404 to user: Instance 2306113c-8f98-42fd-8c0c-3dfac98fff21 could not be found. {{(pid=116272) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 12:27:04.744145 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-7d2c1f64-17da-4565-97cb-cafe4ddd1093 tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "DELETE /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21" status: 404 len: 111 microversion: 2.1 time: 0.036778 Nov 22 12:27:04.753342 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-0f4b5652-6ef4-4221-9364-7581b101cbfe tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:27:04.753960 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-0f4b5652-6ef4-4221-9364-7581b101cbfe tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] [instance: 2306113c-8f98-42fd-8c0c-3dfac98fff21] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:27:04.756306 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 651/1227] 10.222.0.66 () {58 vars in 1238 bytes} [Mon Nov 22 12:27:04 2021] DELETE /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 22 12:27:04.761629 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-0f4b5652-6ef4-4221-9364-7581b101cbfe tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:27:04.762145 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-0f4b5652-6ef4-4221-9364-7581b101cbfe tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:27:04.763343 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-0f4b5652-6ef4-4221-9364-7581b101cbfe tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:27:04.763912 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-0f4b5652-6ef4-4221-9364-7581b101cbfe tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:27:04.780075 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.wsgi [None req-0f4b5652-6ef4-4221-9364-7581b101cbfe tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] HTTP exception thrown: Instance 2306113c-8f98-42fd-8c0c-3dfac98fff21 could not be found. Nov 22 12:27:04.780679 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-0f4b5652-6ef4-4221-9364-7581b101cbfe tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] Returning 404 to user: Instance 2306113c-8f98-42fd-8c0c-3dfac98fff21 could not be found. {{(pid=116273) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 12:27:04.781510 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-0f4b5652-6ef4-4221-9364-7581b101cbfe tempest-AttachVolumeTestJSON-1457378890 tempest-AttachVolumeTestJSON-1457378890-project] 10.222.0.66 "GET /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21" status: 404 len: 111 microversion: 2.1 time: 0.032114 Nov 22 12:27:04.782072 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 577/1228] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:27:04 2021] GET /compute/v2.1/servers/2306113c-8f98-42fd-8c0c-3dfac98fff21 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 22 12:27:05.603547 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-d7593c12-fb9f-453e-abf0-f4678c520988 tempest-VolumesGetTestJSON-661067514 tempest-VolumesGetTestJSON-661067514-project] Calling method '.version_select at 0x7fa1a3d9f430>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:27:05.634191 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.wsgi [None req-d7593c12-fb9f-453e-abf0-f4678c520988 tempest-VolumesGetTestJSON-661067514 tempest-VolumesGetTestJSON-661067514-project] HTTP exception thrown: Volume e608cd69-aadb-4020-b471-421594df1d2b could not be found. Nov 22 12:27:05.635079 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-d7593c12-fb9f-453e-abf0-f4678c520988 tempest-VolumesGetTestJSON-661067514 tempest-VolumesGetTestJSON-661067514-project] Returning 404 to user: Volume e608cd69-aadb-4020-b471-421594df1d2b could not be found. {{(pid=116272) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 12:27:05.636398 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-d7593c12-fb9f-453e-abf0-f4678c520988 tempest-VolumesGetTestJSON-661067514 tempest-VolumesGetTestJSON-661067514-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/e608cd69-aadb-4020-b471-421594df1d2b" status: 404 len: 109 microversion: 2.1 time: 0.036733 Nov 22 12:27:05.636782 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 652/1229] 10.222.0.66 () {58 vars in 1244 bytes} [Mon Nov 22 12:27:05 2021] GET /compute/v2.1/os-volumes/e608cd69-aadb-4020-b471-421594df1d2b => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 22 12:27:14.504736 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-36e94b63-74ed-415b-ac38-904e2a930faf tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Action: 'create', calling method: .version_select at 0x7fa1ac27c820>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-250070142"}} {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:27:14.523812 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.quota [None req-36e94b63-74ed-415b-ac38-904e2a930faf tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Getting quotas for project cb29d996e3de41b0b21ee7ccd827eaea. Resources: {'key_pairs'} {{(pid=116273) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 22 12:27:14.529379 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.quota [None req-36e94b63-74ed-415b-ac38-904e2a930faf tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Getting quotas for user bf2c63ddb0134a3799806162af19c3b5 and project cb29d996e3de41b0b21ee7ccd827eaea. Resources: {'key_pairs'} {{(pid=116273) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 22 12:27:14.943288 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.quota [None req-36e94b63-74ed-415b-ac38-904e2a930faf tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Getting quotas for project cb29d996e3de41b0b21ee7ccd827eaea. Resources: {'key_pairs'} {{(pid=116273) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 22 12:27:14.947534 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.quota [None req-36e94b63-74ed-415b-ac38-904e2a930faf tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Getting quotas for user bf2c63ddb0134a3799806162af19c3b5 and project cb29d996e3de41b0b21ee7ccd827eaea. Resources: {'key_pairs'} {{(pid=116273) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 22 12:27:14.964008 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-36e94b63-74ed-415b-ac38-904e2a930faf tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 2314 microversion: 2.1 time: 0.679151 Nov 22 12:27:14.964698 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 578/1230] 10.222.0.66 () {60 vars in 1157 bytes} [Mon Nov 22 12:27:14 2021] POST /compute/v2.1/os-keypairs => generated 2314 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:27:33.740689 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-ede12a5d-fdae-42b1-a9a1-67c72da466f8 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1427276750", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-250070142", "security_groups": [{"name": "tempest-secgroup-smoke-1723309336"}], "block_device_mapping_v2": [{"uuid": "b0e1c26c-0b70-4fa9-9ad9-4dbb1242c2f0", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "b3fc06d8-5c3b-4a4b-b823-0fcbe71895b9"}]}} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:27:33.862169 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.network.neutron [None req-ede12a5d-fdae-42b1-a9a1-67c72da466f8 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] validate_networks() for [('b3fc06d8-5c3b-4a4b-b823-0fcbe71895b9', None, None, None, None, None)] {{(pid=116272) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 22 12:27:34.276947 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.virt.hardware [None req-ede12a5d-fdae-42b1-a9a1-67c72da466f8 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Flavor limits 0:0:0 {{(pid=116272) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 22 12:27:34.277529 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.virt.hardware [None req-ede12a5d-fdae-42b1-a9a1-67c72da466f8 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Image limits 0:0:0 {{(pid=116272) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 22 12:27:34.278314 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.virt.hardware [None req-ede12a5d-fdae-42b1-a9a1-67c72da466f8 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Flavor pref 0:0:0 {{(pid=116272) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 22 12:27:34.279191 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.virt.hardware [None req-ede12a5d-fdae-42b1-a9a1-67c72da466f8 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Image pref 0:0:0 {{(pid=116272) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 22 12:27:34.279664 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.virt.hardware [None req-ede12a5d-fdae-42b1-a9a1-67c72da466f8 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116272) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 22 12:27:34.293119 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-ede12a5d-fdae-42b1-a9a1-67c72da466f8 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:27:34.293742 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-ede12a5d-fdae-42b1-a9a1-67c72da466f8 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:27:34.295171 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-ede12a5d-fdae-42b1-a9a1-67c72da466f8 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:27:34.295917 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-ede12a5d-fdae-42b1-a9a1-67c72da466f8 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:27:34.317279 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.quota [None req-ede12a5d-fdae-42b1-a9a1-67c72da466f8 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Getting quotas for project cb29d996e3de41b0b21ee7ccd827eaea. Resources: {'ram', 'instances', 'cores'} {{(pid=116272) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 22 12:27:34.321431 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.quota [None req-ede12a5d-fdae-42b1-a9a1-67c72da466f8 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Getting quotas for user bf2c63ddb0134a3799806162af19c3b5 and project cb29d996e3de41b0b21ee7ccd827eaea. Resources: {'ram', 'instances', 'cores'} {{(pid=116272) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 22 12:27:34.378707 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-ede12a5d-fdae-42b1-a9a1-67c72da466f8 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Going to run 1 instances... {{(pid=116272) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 22 12:27:34.381026 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-ede12a5d-fdae-42b1-a9a1-67c72da466f8 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] [instance: 1b4a3c13-ae43-435b-8747-ac95a2dd9aa3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b0e1c26c-0b70-4fa9-9ad9-4dbb1242c2f0',volume_size=None,volume_type=None)] {{(pid=116272) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 22 12:27:34.534131 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-ede12a5d-fdae-42b1-a9a1-67c72da466f8 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.798516 Nov 22 12:27:34.534682 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 653/1231] 10.222.0.66 () {60 vars in 1146 bytes} [Mon Nov 22 12:27:33 2021] POST /compute/v2.1/servers => generated 406 bytes in 800 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 22 12:27:34.545583 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-0a61c00c-811f-4e70-a31f-766697318eef tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:27:34.546177 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-0a61c00c-811f-4e70-a31f-766697318eef tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] [instance: 1b4a3c13-ae43-435b-8747-ac95a2dd9aa3] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:27:34.600911 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-0a61c00c-811f-4e70-a31f-766697318eef tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2c63ddb0134a3799806162af19c3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb29d996e3de41b0b21ee7ccd827eaea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:27:34.610329 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-0a61c00c-811f-4e70-a31f-766697318eef tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] 10.222.0.66 "GET /compute/v2.1/servers/1b4a3c13-ae43-435b-8747-ac95a2dd9aa3" status: 200 len: 1094 microversion: 2.1 time: 0.069217 Nov 22 12:27:34.620533 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 579/1232] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:27:34 2021] GET /compute/v2.1/servers/1b4a3c13-ae43-435b-8747-ac95a2dd9aa3 => generated 1094 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:27:35.628412 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-2a39f752-ed65-4d29-88a7-26afb29e7c53 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:27:35.629108 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-2a39f752-ed65-4d29-88a7-26afb29e7c53 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] [instance: 1b4a3c13-ae43-435b-8747-ac95a2dd9aa3] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:27:35.635241 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-2a39f752-ed65-4d29-88a7-26afb29e7c53 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:27:35.635854 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-2a39f752-ed65-4d29-88a7-26afb29e7c53 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:27:35.636834 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-2a39f752-ed65-4d29-88a7-26afb29e7c53 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:27:35.637446 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-2a39f752-ed65-4d29-88a7-26afb29e7c53 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:27:35.738523 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-2a39f752-ed65-4d29-88a7-26afb29e7c53 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2c63ddb0134a3799806162af19c3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb29d996e3de41b0b21ee7ccd827eaea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:27:35.747295 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-2a39f752-ed65-4d29-88a7-26afb29e7c53 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] 10.222.0.66 "GET /compute/v2.1/servers/1b4a3c13-ae43-435b-8747-ac95a2dd9aa3" status: 200 len: 1210 microversion: 2.1 time: 0.122983 Nov 22 12:27:35.747776 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 654/1233] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:27:35 2021] GET /compute/v2.1/servers/1b4a3c13-ae43-435b-8747-ac95a2dd9aa3 => generated 1210 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:27:36.767440 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-77723a59-a420-449b-b878-afd45f0a4766 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:27:36.768176 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-77723a59-a420-449b-b878-afd45f0a4766 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] [instance: 1b4a3c13-ae43-435b-8747-ac95a2dd9aa3] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:27:36.785312 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-77723a59-a420-449b-b878-afd45f0a4766 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:27:36.787287 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-77723a59-a420-449b-b878-afd45f0a4766 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:27:36.788789 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-77723a59-a420-449b-b878-afd45f0a4766 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:27:36.789619 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-77723a59-a420-449b-b878-afd45f0a4766 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:27:37.056682 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-77723a59-a420-449b-b878-afd45f0a4766 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2c63ddb0134a3799806162af19c3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb29d996e3de41b0b21ee7ccd827eaea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:27:37.068919 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-77723a59-a420-449b-b878-afd45f0a4766 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] 10.222.0.66 "GET /compute/v2.1/servers/1b4a3c13-ae43-435b-8747-ac95a2dd9aa3" status: 200 len: 1266 microversion: 2.1 time: 0.305157 Nov 22 12:27:37.068919 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 580/1234] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:27:36 2021] GET /compute/v2.1/servers/1b4a3c13-ae43-435b-8747-ac95a2dd9aa3 => generated 1266 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:27:37.160779 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [req-15adc394-f22a-42a4-b052-60b63d7b3d75 req-0ca35b8e-b73b-4dcf-8d51-d6b00c0305bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b4a3c13-ae43-435b-8747-ac95a2dd9aa3", "tag": "f03e8079-856f-4a9c-8d1e-ef0f3004d3ba"}]} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:27:37.163315 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 12:27:37.163315 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: warnings.warn(msg) Nov 22 12:27:37.189322 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [req-15adc394-f22a-42a4-b052-60b63d7b3d75 req-0ca35b8e-b73b-4dcf-8d51-d6b00c0305bc service nova] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:27:37.189775 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [req-15adc394-f22a-42a4-b052-60b63d7b3d75 req-0ca35b8e-b73b-4dcf-8d51-d6b00c0305bc service nova] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:27:37.215713 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.compute.server_external_events [req-15adc394-f22a-42a4-b052-60b63d7b3d75 req-0ca35b8e-b73b-4dcf-8d51-d6b00c0305bc service nova] Creating event network-changed:f03e8079-856f-4a9c-8d1e-ef0f3004d3ba for instance 1b4a3c13-ae43-435b-8747-ac95a2dd9aa3 on hv-cinder-76845 Nov 22 12:27:37.228275 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [req-15adc394-f22a-42a4-b052-60b63d7b3d75 req-0ca35b8e-b73b-4dcf-8d51-d6b00c0305bc service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072032 Nov 22 12:27:37.233116 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 655/1235] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Nov 22 12:27:37 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 22 12:27:38.087320 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-3d86e28a-71c3-4d6c-a5fa-a9372b55acc9 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:27:38.087956 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-3d86e28a-71c3-4d6c-a5fa-a9372b55acc9 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] [instance: 1b4a3c13-ae43-435b-8747-ac95a2dd9aa3] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:27:38.095442 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-3d86e28a-71c3-4d6c-a5fa-a9372b55acc9 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:27:38.096399 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-3d86e28a-71c3-4d6c-a5fa-a9372b55acc9 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:27:38.097212 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-3d86e28a-71c3-4d6c-a5fa-a9372b55acc9 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:27:38.097642 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-3d86e28a-71c3-4d6c-a5fa-a9372b55acc9 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:27:38.347378 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-3d86e28a-71c3-4d6c-a5fa-a9372b55acc9 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2c63ddb0134a3799806162af19c3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb29d996e3de41b0b21ee7ccd827eaea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:27:38.359106 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-3d86e28a-71c3-4d6c-a5fa-a9372b55acc9 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] 10.222.0.66 "GET /compute/v2.1/servers/1b4a3c13-ae43-435b-8747-ac95a2dd9aa3" status: 200 len: 1266 microversion: 2.1 time: 0.277951 Nov 22 12:27:38.359794 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 581/1236] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:27:38 2021] GET /compute/v2.1/servers/1b4a3c13-ae43-435b-8747-ac95a2dd9aa3 => generated 1266 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:27:39.377045 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-ac88db0e-b72b-4028-a97c-d8ae1bab7016 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:27:39.378418 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-ac88db0e-b72b-4028-a97c-d8ae1bab7016 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] [instance: 1b4a3c13-ae43-435b-8747-ac95a2dd9aa3] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:27:39.385329 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-ac88db0e-b72b-4028-a97c-d8ae1bab7016 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:27:39.386457 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-ac88db0e-b72b-4028-a97c-d8ae1bab7016 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:27:39.387573 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-ac88db0e-b72b-4028-a97c-d8ae1bab7016 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:27:39.387996 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-ac88db0e-b72b-4028-a97c-d8ae1bab7016 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:27:39.572732 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-ac88db0e-b72b-4028-a97c-d8ae1bab7016 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2c63ddb0134a3799806162af19c3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb29d996e3de41b0b21ee7ccd827eaea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:27:39.589605 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-ac88db0e-b72b-4028-a97c-d8ae1bab7016 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] 10.222.0.66 "GET /compute/v2.1/servers/1b4a3c13-ae43-435b-8747-ac95a2dd9aa3" status: 200 len: 1266 microversion: 2.1 time: 0.216388 Nov 22 12:27:39.590297 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 656/1237] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:27:39 2021] GET /compute/v2.1/servers/1b4a3c13-ae43-435b-8747-ac95a2dd9aa3 => generated 1266 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:27:40.608206 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-baa654d7-b252-4c3d-8d09-8dca5a4773bc tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:27:40.608924 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-baa654d7-b252-4c3d-8d09-8dca5a4773bc tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] [instance: 1b4a3c13-ae43-435b-8747-ac95a2dd9aa3] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:27:40.615025 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-baa654d7-b252-4c3d-8d09-8dca5a4773bc tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:27:40.615711 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-baa654d7-b252-4c3d-8d09-8dca5a4773bc tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:27:40.616489 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-baa654d7-b252-4c3d-8d09-8dca5a4773bc tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:27:40.616927 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-baa654d7-b252-4c3d-8d09-8dca5a4773bc tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:27:40.769491 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-baa654d7-b252-4c3d-8d09-8dca5a4773bc tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2c63ddb0134a3799806162af19c3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb29d996e3de41b0b21ee7ccd827eaea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:27:40.777638 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-baa654d7-b252-4c3d-8d09-8dca5a4773bc tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] 10.222.0.66 "GET /compute/v2.1/servers/1b4a3c13-ae43-435b-8747-ac95a2dd9aa3" status: 200 len: 1266 microversion: 2.1 time: 0.172540 Nov 22 12:27:40.778360 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 582/1238] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:27:40 2021] GET /compute/v2.1/servers/1b4a3c13-ae43-435b-8747-ac95a2dd9aa3 => generated 1266 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:27:41.801563 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-60fa1454-4225-4bb6-865d-349abb2de706 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:27:41.804034 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-60fa1454-4225-4bb6-865d-349abb2de706 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] [instance: 1b4a3c13-ae43-435b-8747-ac95a2dd9aa3] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:27:41.814830 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-60fa1454-4225-4bb6-865d-349abb2de706 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:27:41.815308 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-60fa1454-4225-4bb6-865d-349abb2de706 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:27:41.816106 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-60fa1454-4225-4bb6-865d-349abb2de706 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:27:41.816530 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-60fa1454-4225-4bb6-865d-349abb2de706 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:27:41.955830 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-60fa1454-4225-4bb6-865d-349abb2de706 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2c63ddb0134a3799806162af19c3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb29d996e3de41b0b21ee7ccd827eaea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:27:41.963474 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-60fa1454-4225-4bb6-865d-349abb2de706 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] 10.222.0.66 "GET /compute/v2.1/servers/1b4a3c13-ae43-435b-8747-ac95a2dd9aa3" status: 200 len: 1266 microversion: 2.1 time: 0.169985 Nov 22 12:27:41.964301 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 657/1239] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:27:41 2021] GET /compute/v2.1/servers/1b4a3c13-ae43-435b-8747-ac95a2dd9aa3 => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:27:42.982741 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-97ef9aa2-cd6d-4d9f-bab0-8a1f9ce4b431 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:27:42.983402 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-97ef9aa2-cd6d-4d9f-bab0-8a1f9ce4b431 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] [instance: 1b4a3c13-ae43-435b-8747-ac95a2dd9aa3] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:27:42.990119 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-97ef9aa2-cd6d-4d9f-bab0-8a1f9ce4b431 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:27:42.990575 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-97ef9aa2-cd6d-4d9f-bab0-8a1f9ce4b431 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:27:42.991702 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-97ef9aa2-cd6d-4d9f-bab0-8a1f9ce4b431 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:27:42.991823 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-97ef9aa2-cd6d-4d9f-bab0-8a1f9ce4b431 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:27:43.135260 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-97ef9aa2-cd6d-4d9f-bab0-8a1f9ce4b431 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2c63ddb0134a3799806162af19c3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb29d996e3de41b0b21ee7ccd827eaea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:27:43.144435 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-97ef9aa2-cd6d-4d9f-bab0-8a1f9ce4b431 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] 10.222.0.66 "GET /compute/v2.1/servers/1b4a3c13-ae43-435b-8747-ac95a2dd9aa3" status: 200 len: 1266 microversion: 2.1 time: 0.166100 Nov 22 12:27:43.145074 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 583/1240] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:27:42 2021] GET /compute/v2.1/servers/1b4a3c13-ae43-435b-8747-ac95a2dd9aa3 => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:27:44.164260 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-fe37e993-c0a9-45ab-ba98-d3c008d5a027 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:27:44.164964 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-fe37e993-c0a9-45ab-ba98-d3c008d5a027 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] [instance: 1b4a3c13-ae43-435b-8747-ac95a2dd9aa3] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:27:44.172963 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-fe37e993-c0a9-45ab-ba98-d3c008d5a027 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:27:44.173422 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-fe37e993-c0a9-45ab-ba98-d3c008d5a027 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:27:44.174217 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-fe37e993-c0a9-45ab-ba98-d3c008d5a027 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:27:44.174722 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-fe37e993-c0a9-45ab-ba98-d3c008d5a027 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:27:44.366174 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-fe37e993-c0a9-45ab-ba98-d3c008d5a027 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2c63ddb0134a3799806162af19c3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb29d996e3de41b0b21ee7ccd827eaea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:27:44.374952 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-fe37e993-c0a9-45ab-ba98-d3c008d5a027 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] 10.222.0.66 "GET /compute/v2.1/servers/1b4a3c13-ae43-435b-8747-ac95a2dd9aa3" status: 200 len: 1266 microversion: 2.1 time: 0.215025 Nov 22 12:27:44.375758 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 658/1241] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:27:44 2021] GET /compute/v2.1/servers/1b4a3c13-ae43-435b-8747-ac95a2dd9aa3 => generated 1266 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:27:45.392877 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-9ca30f7b-ee6c-460b-ae70-82ec00fe220f tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:27:45.393497 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-9ca30f7b-ee6c-460b-ae70-82ec00fe220f tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] [instance: 1b4a3c13-ae43-435b-8747-ac95a2dd9aa3] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:27:45.400393 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-9ca30f7b-ee6c-460b-ae70-82ec00fe220f tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:27:45.400837 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-9ca30f7b-ee6c-460b-ae70-82ec00fe220f tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:27:45.401615 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-9ca30f7b-ee6c-460b-ae70-82ec00fe220f tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:27:45.402038 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-9ca30f7b-ee6c-460b-ae70-82ec00fe220f tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:27:45.544666 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-9ca30f7b-ee6c-460b-ae70-82ec00fe220f tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2c63ddb0134a3799806162af19c3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb29d996e3de41b0b21ee7ccd827eaea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:27:45.552740 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-9ca30f7b-ee6c-460b-ae70-82ec00fe220f tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] 10.222.0.66 "GET /compute/v2.1/servers/1b4a3c13-ae43-435b-8747-ac95a2dd9aa3" status: 200 len: 1266 microversion: 2.1 time: 0.163541 Nov 22 12:27:45.553376 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 584/1242] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:27:45 2021] GET /compute/v2.1/servers/1b4a3c13-ae43-435b-8747-ac95a2dd9aa3 => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:27:46.570247 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-88fc6d23-95b6-4fcc-92c9-610b5b51c39e tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:27:46.570879 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-88fc6d23-95b6-4fcc-92c9-610b5b51c39e tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] [instance: 1b4a3c13-ae43-435b-8747-ac95a2dd9aa3] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:27:46.578267 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-88fc6d23-95b6-4fcc-92c9-610b5b51c39e tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:27:46.578723 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-88fc6d23-95b6-4fcc-92c9-610b5b51c39e tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:27:46.579535 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-88fc6d23-95b6-4fcc-92c9-610b5b51c39e tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:27:46.579953 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-88fc6d23-95b6-4fcc-92c9-610b5b51c39e tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:27:46.721102 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-88fc6d23-95b6-4fcc-92c9-610b5b51c39e tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2c63ddb0134a3799806162af19c3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb29d996e3de41b0b21ee7ccd827eaea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:27:46.732549 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-88fc6d23-95b6-4fcc-92c9-610b5b51c39e tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] 10.222.0.66 "GET /compute/v2.1/servers/1b4a3c13-ae43-435b-8747-ac95a2dd9aa3" status: 200 len: 1266 microversion: 2.1 time: 0.165748 Nov 22 12:27:46.733109 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 659/1243] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:27:46 2021] GET /compute/v2.1/servers/1b4a3c13-ae43-435b-8747-ac95a2dd9aa3 => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:27:47.754606 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-1c2c02c8-1426-4046-8122-d892402ad458 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:27:47.755169 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-1c2c02c8-1426-4046-8122-d892402ad458 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] [instance: 1b4a3c13-ae43-435b-8747-ac95a2dd9aa3] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:27:47.762470 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-1c2c02c8-1426-4046-8122-d892402ad458 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:27:47.762935 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-1c2c02c8-1426-4046-8122-d892402ad458 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:27:47.763871 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-1c2c02c8-1426-4046-8122-d892402ad458 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:27:47.764335 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-1c2c02c8-1426-4046-8122-d892402ad458 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:27:47.918437 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-1c2c02c8-1426-4046-8122-d892402ad458 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2c63ddb0134a3799806162af19c3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb29d996e3de41b0b21ee7ccd827eaea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:27:47.928734 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-1c2c02c8-1426-4046-8122-d892402ad458 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] 10.222.0.66 "GET /compute/v2.1/servers/1b4a3c13-ae43-435b-8747-ac95a2dd9aa3" status: 200 len: 1266 microversion: 2.1 time: 0.178029 Nov 22 12:27:47.929713 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 585/1244] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:27:47 2021] GET /compute/v2.1/servers/1b4a3c13-ae43-435b-8747-ac95a2dd9aa3 => generated 1266 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:27:48.089534 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [req-86bf9d1b-3927-49d0-82c7-d7d3c5e612af req-c556f98c-3594-40d1-b482-6d1daaeb029a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b4a3c13-ae43-435b-8747-ac95a2dd9aa3", "name": "network-vif-plugged", "status": "completed", "tag": "f03e8079-856f-4a9c-8d1e-ef0f3004d3ba"}]} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:27:48.095451 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 12:27:48.095451 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: warnings.warn(msg) Nov 22 12:27:48.099169 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [req-86bf9d1b-3927-49d0-82c7-d7d3c5e612af req-c556f98c-3594-40d1-b482-6d1daaeb029a service nova] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:27:48.099721 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [req-86bf9d1b-3927-49d0-82c7-d7d3c5e612af req-c556f98c-3594-40d1-b482-6d1daaeb029a service nova] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:27:48.112564 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.compute.server_external_events [req-86bf9d1b-3927-49d0-82c7-d7d3c5e612af req-c556f98c-3594-40d1-b482-6d1daaeb029a service nova] Creating event network-vif-plugged:f03e8079-856f-4a9c-8d1e-ef0f3004d3ba for instance 1b4a3c13-ae43-435b-8747-ac95a2dd9aa3 on hv-cinder-76845 Nov 22 12:27:48.118320 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [req-86bf9d1b-3927-49d0-82c7-d7d3c5e612af req-c556f98c-3594-40d1-b482-6d1daaeb029a service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032390 Nov 22 12:27:48.119298 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 660/1245] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Nov 22 12:27:48 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 12:27:48.951167 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-6221fe0e-ec21-41f1-bb22-dd9d8696b932 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:27:48.951776 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-6221fe0e-ec21-41f1-bb22-dd9d8696b932 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] [instance: 1b4a3c13-ae43-435b-8747-ac95a2dd9aa3] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:27:48.958933 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-6221fe0e-ec21-41f1-bb22-dd9d8696b932 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:27:48.959416 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-6221fe0e-ec21-41f1-bb22-dd9d8696b932 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:27:48.960196 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-6221fe0e-ec21-41f1-bb22-dd9d8696b932 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:27:48.960623 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-6221fe0e-ec21-41f1-bb22-dd9d8696b932 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:27:49.116352 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-6221fe0e-ec21-41f1-bb22-dd9d8696b932 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2c63ddb0134a3799806162af19c3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb29d996e3de41b0b21ee7ccd827eaea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:27:49.125054 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-6221fe0e-ec21-41f1-bb22-dd9d8696b932 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] 10.222.0.66 "GET /compute/v2.1/servers/1b4a3c13-ae43-435b-8747-ac95a2dd9aa3" status: 200 len: 1266 microversion: 2.1 time: 0.179672 Nov 22 12:27:49.125290 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 586/1246] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:27:48 2021] GET /compute/v2.1/servers/1b4a3c13-ae43-435b-8747-ac95a2dd9aa3 => generated 1266 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:27:50.144837 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-3063c27e-d0bd-4bd0-a4d2-9af962dfc0dc tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:27:50.145517 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-3063c27e-d0bd-4bd0-a4d2-9af962dfc0dc tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] [instance: 1b4a3c13-ae43-435b-8747-ac95a2dd9aa3] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:27:50.155198 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-3063c27e-d0bd-4bd0-a4d2-9af962dfc0dc tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:27:50.155748 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-3063c27e-d0bd-4bd0-a4d2-9af962dfc0dc tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:27:50.156840 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-3063c27e-d0bd-4bd0-a4d2-9af962dfc0dc tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:27:50.157401 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-3063c27e-d0bd-4bd0-a4d2-9af962dfc0dc tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:27:50.301854 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-3063c27e-d0bd-4bd0-a4d2-9af962dfc0dc tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2c63ddb0134a3799806162af19c3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb29d996e3de41b0b21ee7ccd827eaea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:27:50.310580 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-3063c27e-d0bd-4bd0-a4d2-9af962dfc0dc tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] 10.222.0.66 "GET /compute/v2.1/servers/1b4a3c13-ae43-435b-8747-ac95a2dd9aa3" status: 200 len: 1454 microversion: 2.1 time: 0.171501 Nov 22 12:27:50.318452 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 661/1247] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:27:50 2021] GET /compute/v2.1/servers/1b4a3c13-ae43-435b-8747-ac95a2dd9aa3 => generated 1454 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:27:50.329256 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-d3336d3b-d45b-4848-b64b-70e85aa00a0e tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:27:50.329881 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-d3336d3b-d45b-4848-b64b-70e85aa00a0e tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] [instance: 1b4a3c13-ae43-435b-8747-ac95a2dd9aa3] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:27:50.336492 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-d3336d3b-d45b-4848-b64b-70e85aa00a0e tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:27:50.336927 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-d3336d3b-d45b-4848-b64b-70e85aa00a0e tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:27:50.337695 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-d3336d3b-d45b-4848-b64b-70e85aa00a0e tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:27:50.338115 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-d3336d3b-d45b-4848-b64b-70e85aa00a0e tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:27:50.487010 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-d3336d3b-d45b-4848-b64b-70e85aa00a0e tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2c63ddb0134a3799806162af19c3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb29d996e3de41b0b21ee7ccd827eaea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:27:50.497253 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-d3336d3b-d45b-4848-b64b-70e85aa00a0e tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] 10.222.0.66 "GET /compute/v2.1/servers/1b4a3c13-ae43-435b-8747-ac95a2dd9aa3" status: 200 len: 1454 microversion: 2.1 time: 0.171435 Nov 22 12:27:50.498080 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 587/1248] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:27:50 2021] GET /compute/v2.1/servers/1b4a3c13-ae43-435b-8747-ac95a2dd9aa3 => generated 1454 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 12:27:52.775481 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [req-970f277f-784c-4712-a965-d8f00558d65f req-7dfec25e-566d-477f-94ae-4948dc9072f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b4a3c13-ae43-435b-8747-ac95a2dd9aa3", "tag": "f03e8079-856f-4a9c-8d1e-ef0f3004d3ba"}]} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:27:52.777223 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 12:27:52.777223 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: warnings.warn(msg) Nov 22 12:27:52.789804 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [req-970f277f-784c-4712-a965-d8f00558d65f req-7dfec25e-566d-477f-94ae-4948dc9072f8 service nova] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:27:52.790346 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [req-970f277f-784c-4712-a965-d8f00558d65f req-7dfec25e-566d-477f-94ae-4948dc9072f8 service nova] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:27:52.803460 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.compute.server_external_events [req-970f277f-784c-4712-a965-d8f00558d65f req-7dfec25e-566d-477f-94ae-4948dc9072f8 service nova] Creating event network-changed:f03e8079-856f-4a9c-8d1e-ef0f3004d3ba for instance 1b4a3c13-ae43-435b-8747-ac95a2dd9aa3 on hv-cinder-76845 Nov 22 12:27:52.809344 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [req-970f277f-784c-4712-a965-d8f00558d65f req-7dfec25e-566d-477f-94ae-4948dc9072f8 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037503 Nov 22 12:27:52.810228 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 662/1249] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Nov 22 12:27:52 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 12:29:29.322579 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 22 12:29:29.323185 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: Mon Nov 22 12:29:29 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 22 12:29:50.122329 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-de7dcab3-bc21-4a43-9312-86d194a9952f tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:29:50.123117 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-de7dcab3-bc21-4a43-9312-86d194a9952f tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] [instance: 1b4a3c13-ae43-435b-8747-ac95a2dd9aa3] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:29:50.129589 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-de7dcab3-bc21-4a43-9312-86d194a9952f tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:29:50.130034 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-de7dcab3-bc21-4a43-9312-86d194a9952f tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:29:50.130825 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-de7dcab3-bc21-4a43-9312-86d194a9952f tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:29:50.131270 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-de7dcab3-bc21-4a43-9312-86d194a9952f tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:29:50.157077 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-de7dcab3-bc21-4a43-9312-86d194a9952f tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] [instance: 1b4a3c13-ae43-435b-8747-ac95a2dd9aa3] Going to try to terminate instance {{(pid=116273) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 22 12:29:50.242689 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-de7dcab3-bc21-4a43-9312-86d194a9952f tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] 10.222.0.66 "DELETE /compute/v2.1/servers/1b4a3c13-ae43-435b-8747-ac95a2dd9aa3" status: 204 len: 0 microversion: 2.1 time: 0.125940 Nov 22 12:29:50.244399 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 588/1250] 10.222.0.66 () {58 vars in 1238 bytes} [Mon Nov 22 12:29:50 2021] DELETE /compute/v2.1/servers/1b4a3c13-ae43-435b-8747-ac95a2dd9aa3 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 22 12:29:50.254056 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-67ec0191-7c79-4736-bca3-6fad03ce63fb tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:29:50.254761 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-67ec0191-7c79-4736-bca3-6fad03ce63fb tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] [instance: 1b4a3c13-ae43-435b-8747-ac95a2dd9aa3] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:29:50.261208 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-67ec0191-7c79-4736-bca3-6fad03ce63fb tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:29:50.261659 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-67ec0191-7c79-4736-bca3-6fad03ce63fb tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:29:50.262452 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-67ec0191-7c79-4736-bca3-6fad03ce63fb tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:29:50.262885 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-67ec0191-7c79-4736-bca3-6fad03ce63fb tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:29:50.579809 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-67ec0191-7c79-4736-bca3-6fad03ce63fb tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2c63ddb0134a3799806162af19c3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb29d996e3de41b0b21ee7ccd827eaea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:29:50.590450 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-67ec0191-7c79-4736-bca3-6fad03ce63fb tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] 10.222.0.66 "GET /compute/v2.1/servers/1b4a3c13-ae43-435b-8747-ac95a2dd9aa3" status: 200 len: 1579 microversion: 2.1 time: 0.341323 Nov 22 12:29:50.591047 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 663/1251] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:29:50 2021] GET /compute/v2.1/servers/1b4a3c13-ae43-435b-8747-ac95a2dd9aa3 => generated 1579 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:29:51.613816 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-3aa7245a-5d9b-410c-b1d1-ce5c0fc2aea7 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:29:51.614659 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-3aa7245a-5d9b-410c-b1d1-ce5c0fc2aea7 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] [instance: 1b4a3c13-ae43-435b-8747-ac95a2dd9aa3] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:29:51.622953 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-3aa7245a-5d9b-410c-b1d1-ce5c0fc2aea7 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:29:51.623435 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-3aa7245a-5d9b-410c-b1d1-ce5c0fc2aea7 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:29:51.624226 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-3aa7245a-5d9b-410c-b1d1-ce5c0fc2aea7 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:29:51.624653 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-3aa7245a-5d9b-410c-b1d1-ce5c0fc2aea7 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:29:51.867557 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-3aa7245a-5d9b-410c-b1d1-ce5c0fc2aea7 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2c63ddb0134a3799806162af19c3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb29d996e3de41b0b21ee7ccd827eaea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:29:51.876524 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-3aa7245a-5d9b-410c-b1d1-ce5c0fc2aea7 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] 10.222.0.66 "GET /compute/v2.1/servers/1b4a3c13-ae43-435b-8747-ac95a2dd9aa3" status: 200 len: 1579 microversion: 2.1 time: 0.267973 Nov 22 12:29:51.877341 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 589/1252] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:29:51 2021] GET /compute/v2.1/servers/1b4a3c13-ae43-435b-8747-ac95a2dd9aa3 => generated 1579 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:29:52.762722 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [req-7225774b-0dc7-4d91-93bd-c21681c289df req-037f835d-a109-41d5-b4b6-afbea895a2b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b4a3c13-ae43-435b-8747-ac95a2dd9aa3", "name": "network-vif-deleted", "tag": "f03e8079-856f-4a9c-8d1e-ef0f3004d3ba"}]} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:29:52.764640 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 12:29:52.764640 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: warnings.warn(msg) Nov 22 12:29:52.773495 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [req-7225774b-0dc7-4d91-93bd-c21681c289df req-037f835d-a109-41d5-b4b6-afbea895a2b0 service nova] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:29:52.773945 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [req-7225774b-0dc7-4d91-93bd-c21681c289df req-037f835d-a109-41d5-b4b6-afbea895a2b0 service nova] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:29:52.787115 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.compute.server_external_events [req-7225774b-0dc7-4d91-93bd-c21681c289df req-037f835d-a109-41d5-b4b6-afbea895a2b0 service nova] Creating event network-vif-deleted:f03e8079-856f-4a9c-8d1e-ef0f3004d3ba for instance 1b4a3c13-ae43-435b-8747-ac95a2dd9aa3 on hv-cinder-76845 Nov 22 12:29:52.792751 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [req-7225774b-0dc7-4d91-93bd-c21681c289df req-037f835d-a109-41d5-b4b6-afbea895a2b0 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034043 Nov 22 12:29:52.793629 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 664/1253] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Nov 22 12:29:52 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 22 12:29:52.895004 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-8a667a4b-b560-4daf-9b8c-964a399624b4 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:29:52.896192 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-8a667a4b-b560-4daf-9b8c-964a399624b4 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] [instance: 1b4a3c13-ae43-435b-8747-ac95a2dd9aa3] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:29:52.913904 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-8a667a4b-b560-4daf-9b8c-964a399624b4 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:29:52.914390 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-8a667a4b-b560-4daf-9b8c-964a399624b4 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:29:52.915190 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-8a667a4b-b560-4daf-9b8c-964a399624b4 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:29:52.915664 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-8a667a4b-b560-4daf-9b8c-964a399624b4 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:29:52.987617 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-8a667a4b-b560-4daf-9b8c-964a399624b4 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2c63ddb0134a3799806162af19c3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb29d996e3de41b0b21ee7ccd827eaea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:29:52.996874 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-8a667a4b-b560-4daf-9b8c-964a399624b4 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] 10.222.0.66 "GET /compute/v2.1/servers/1b4a3c13-ae43-435b-8747-ac95a2dd9aa3" status: 200 len: 1225 microversion: 2.1 time: 0.105678 Nov 22 12:29:52.998104 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 590/1254] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:29:52 2021] GET /compute/v2.1/servers/1b4a3c13-ae43-435b-8747-ac95a2dd9aa3 => generated 1225 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:29:54.015886 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-8f896797-076a-4a54-9d9e-c0785a8b9b5f tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:29:54.016486 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-8f896797-076a-4a54-9d9e-c0785a8b9b5f tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] [instance: 1b4a3c13-ae43-435b-8747-ac95a2dd9aa3] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:29:54.024944 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-8f896797-076a-4a54-9d9e-c0785a8b9b5f tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:29:54.025376 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-8f896797-076a-4a54-9d9e-c0785a8b9b5f tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:29:54.026189 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-8f896797-076a-4a54-9d9e-c0785a8b9b5f tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:29:54.026756 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-8f896797-076a-4a54-9d9e-c0785a8b9b5f tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:29:54.041464 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.wsgi [None req-8f896797-076a-4a54-9d9e-c0785a8b9b5f tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] HTTP exception thrown: Instance 1b4a3c13-ae43-435b-8747-ac95a2dd9aa3 could not be found. Nov 22 12:29:54.042115 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-8f896797-076a-4a54-9d9e-c0785a8b9b5f tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Returning 404 to user: Instance 1b4a3c13-ae43-435b-8747-ac95a2dd9aa3 could not be found. {{(pid=116272) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 12:29:54.043218 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-8f896797-076a-4a54-9d9e-c0785a8b9b5f tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] 10.222.0.66 "GET /compute/v2.1/servers/1b4a3c13-ae43-435b-8747-ac95a2dd9aa3" status: 404 len: 111 microversion: 2.1 time: 0.032754 Nov 22 12:29:54.043826 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 665/1255] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:29:54 2021] GET /compute/v2.1/servers/1b4a3c13-ae43-435b-8747-ac95a2dd9aa3 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 22 12:29:54.142375 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-9ba806b6-27b4-4277-a254-ad14761bddf6 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1887127882", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-250070142", "security_groups": [{"name": "tempest-secgroup-smoke-1723309336"}], "block_device_mapping_v2": [{"uuid": "b0e1c26c-0b70-4fa9-9ad9-4dbb1242c2f0", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "b3fc06d8-5c3b-4a4b-b823-0fcbe71895b9"}]}} {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:29:54.270218 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.network.neutron [None req-9ba806b6-27b4-4277-a254-ad14761bddf6 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] validate_networks() for [('b3fc06d8-5c3b-4a4b-b823-0fcbe71895b9', None, None, None, None, None)] {{(pid=116273) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 22 12:29:54.685157 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.virt.hardware [None req-9ba806b6-27b4-4277-a254-ad14761bddf6 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Flavor limits 0:0:0 {{(pid=116273) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 22 12:29:54.685605 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.virt.hardware [None req-9ba806b6-27b4-4277-a254-ad14761bddf6 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Image limits 0:0:0 {{(pid=116273) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 22 12:29:54.686044 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.virt.hardware [None req-9ba806b6-27b4-4277-a254-ad14761bddf6 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Flavor pref 0:0:0 {{(pid=116273) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 22 12:29:54.686525 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.virt.hardware [None req-9ba806b6-27b4-4277-a254-ad14761bddf6 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Image pref 0:0:0 {{(pid=116273) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 22 12:29:54.686932 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.virt.hardware [None req-9ba806b6-27b4-4277-a254-ad14761bddf6 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116273) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 22 12:29:54.699215 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-9ba806b6-27b4-4277-a254-ad14761bddf6 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:29:54.699685 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-9ba806b6-27b4-4277-a254-ad14761bddf6 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:29:54.700493 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-9ba806b6-27b4-4277-a254-ad14761bddf6 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:29:54.700922 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-9ba806b6-27b4-4277-a254-ad14761bddf6 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:29:54.719624 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.quota [None req-9ba806b6-27b4-4277-a254-ad14761bddf6 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Getting quotas for project cb29d996e3de41b0b21ee7ccd827eaea. Resources: {'ram', 'instances', 'cores'} {{(pid=116273) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 22 12:29:54.723897 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.quota [None req-9ba806b6-27b4-4277-a254-ad14761bddf6 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Getting quotas for user bf2c63ddb0134a3799806162af19c3b5 and project cb29d996e3de41b0b21ee7ccd827eaea. Resources: {'ram', 'instances', 'cores'} {{(pid=116273) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 22 12:29:54.787222 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-9ba806b6-27b4-4277-a254-ad14761bddf6 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Going to run 1 instances... {{(pid=116273) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 22 12:29:54.790252 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-9ba806b6-27b4-4277-a254-ad14761bddf6 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] [instance: 059fc536-4c3e-42ae-889d-9d87177ef9dd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b0e1c26c-0b70-4fa9-9ad9-4dbb1242c2f0',volume_size=None,volume_type=None)] {{(pid=116273) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 22 12:29:54.926895 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-9ba806b6-27b4-4277-a254-ad14761bddf6 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.788319 Nov 22 12:29:54.927729 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 591/1256] 10.222.0.66 () {60 vars in 1146 bytes} [Mon Nov 22 12:29:54 2021] POST /compute/v2.1/servers => generated 406 bytes in 790 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 22 12:29:54.939163 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-4f53433c-34d6-483e-b179-59a8138c9cc0 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:29:54.939910 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-4f53433c-34d6-483e-b179-59a8138c9cc0 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] [instance: 059fc536-4c3e-42ae-889d-9d87177ef9dd] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:29:55.006726 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-4f53433c-34d6-483e-b179-59a8138c9cc0 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2c63ddb0134a3799806162af19c3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb29d996e3de41b0b21ee7ccd827eaea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:29:55.015676 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-4f53433c-34d6-483e-b179-59a8138c9cc0 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] 10.222.0.66 "GET /compute/v2.1/servers/059fc536-4c3e-42ae-889d-9d87177ef9dd" status: 200 len: 1094 microversion: 2.1 time: 0.081250 Nov 22 12:29:55.016244 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 666/1257] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:29:54 2021] GET /compute/v2.1/servers/059fc536-4c3e-42ae-889d-9d87177ef9dd => generated 1094 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:29:56.035003 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-03bb1f02-8188-4081-b14e-db2462be2ff2 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:29:56.036292 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-03bb1f02-8188-4081-b14e-db2462be2ff2 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] [instance: 059fc536-4c3e-42ae-889d-9d87177ef9dd] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:29:56.044435 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-03bb1f02-8188-4081-b14e-db2462be2ff2 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:29:56.045836 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-03bb1f02-8188-4081-b14e-db2462be2ff2 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:29:56.046705 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-03bb1f02-8188-4081-b14e-db2462be2ff2 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:29:56.047134 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-03bb1f02-8188-4081-b14e-db2462be2ff2 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:29:56.148304 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-03bb1f02-8188-4081-b14e-db2462be2ff2 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2c63ddb0134a3799806162af19c3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb29d996e3de41b0b21ee7ccd827eaea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:29:56.156769 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-03bb1f02-8188-4081-b14e-db2462be2ff2 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] 10.222.0.66 "GET /compute/v2.1/servers/059fc536-4c3e-42ae-889d-9d87177ef9dd" status: 200 len: 1200 microversion: 2.1 time: 0.126320 Nov 22 12:29:56.157898 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 592/1258] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:29:56 2021] GET /compute/v2.1/servers/059fc536-4c3e-42ae-889d-9d87177ef9dd => generated 1200 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:29:57.175090 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-994a5d63-1647-47e9-87ef-3e9132421f67 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:29:57.175891 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-994a5d63-1647-47e9-87ef-3e9132421f67 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] [instance: 059fc536-4c3e-42ae-889d-9d87177ef9dd] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:29:57.190169 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-994a5d63-1647-47e9-87ef-3e9132421f67 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:29:57.190723 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-994a5d63-1647-47e9-87ef-3e9132421f67 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:29:57.191657 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-994a5d63-1647-47e9-87ef-3e9132421f67 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:29:57.192191 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-994a5d63-1647-47e9-87ef-3e9132421f67 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:29:57.739431 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-994a5d63-1647-47e9-87ef-3e9132421f67 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2c63ddb0134a3799806162af19c3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb29d996e3de41b0b21ee7ccd827eaea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:29:57.747200 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-994a5d63-1647-47e9-87ef-3e9132421f67 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] 10.222.0.66 "GET /compute/v2.1/servers/059fc536-4c3e-42ae-889d-9d87177ef9dd" status: 200 len: 1266 microversion: 2.1 time: 0.575889 Nov 22 12:29:57.747851 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 667/1259] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:29:57 2021] GET /compute/v2.1/servers/059fc536-4c3e-42ae-889d-9d87177ef9dd => generated 1266 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:29:58.099417 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [req-955ad5a0-1ed9-499e-ac19-4ed6dc80bef9 req-1ed2e1f0-fcd5-48ae-97fa-af283e7031e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "059fc536-4c3e-42ae-889d-9d87177ef9dd", "tag": "33464858-d2a4-4a97-b98e-ab0137a739a1"}]} {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:29:58.100948 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 12:29:58.100948 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: warnings.warn(msg) Nov 22 12:29:58.116964 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [req-955ad5a0-1ed9-499e-ac19-4ed6dc80bef9 req-1ed2e1f0-fcd5-48ae-97fa-af283e7031e8 service nova] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:29:58.117519 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [req-955ad5a0-1ed9-499e-ac19-4ed6dc80bef9 req-1ed2e1f0-fcd5-48ae-97fa-af283e7031e8 service nova] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:29:58.129668 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.compute.server_external_events [req-955ad5a0-1ed9-499e-ac19-4ed6dc80bef9 req-1ed2e1f0-fcd5-48ae-97fa-af283e7031e8 service nova] Creating event network-changed:33464858-d2a4-4a97-b98e-ab0137a739a1 for instance 059fc536-4c3e-42ae-889d-9d87177ef9dd on hv-cinder-76845 Nov 22 12:29:58.143255 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [req-955ad5a0-1ed9-499e-ac19-4ed6dc80bef9 req-1ed2e1f0-fcd5-48ae-97fa-af283e7031e8 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048181 Nov 22 12:29:58.144340 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 593/1260] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Nov 22 12:29:58 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 12:29:58.765600 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-c99a6939-a765-4b12-b82b-0f2f21b7b8c2 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:29:58.766214 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-c99a6939-a765-4b12-b82b-0f2f21b7b8c2 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] [instance: 059fc536-4c3e-42ae-889d-9d87177ef9dd] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:29:58.772830 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-c99a6939-a765-4b12-b82b-0f2f21b7b8c2 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:29:58.773282 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-c99a6939-a765-4b12-b82b-0f2f21b7b8c2 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:29:58.774081 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-c99a6939-a765-4b12-b82b-0f2f21b7b8c2 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:29:58.774512 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-c99a6939-a765-4b12-b82b-0f2f21b7b8c2 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:29:58.998478 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-c99a6939-a765-4b12-b82b-0f2f21b7b8c2 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2c63ddb0134a3799806162af19c3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb29d996e3de41b0b21ee7ccd827eaea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:29:59.006322 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-c99a6939-a765-4b12-b82b-0f2f21b7b8c2 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] 10.222.0.66 "GET /compute/v2.1/servers/059fc536-4c3e-42ae-889d-9d87177ef9dd" status: 200 len: 1266 microversion: 2.1 time: 0.245115 Nov 22 12:29:59.014732 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 668/1261] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:29:58 2021] GET /compute/v2.1/servers/059fc536-4c3e-42ae-889d-9d87177ef9dd => generated 1266 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:30:00.025777 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-6a43263d-312a-4702-929c-17c6676cdfae tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:30:00.026662 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-6a43263d-312a-4702-929c-17c6676cdfae tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] [instance: 059fc536-4c3e-42ae-889d-9d87177ef9dd] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:30:00.033608 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-6a43263d-312a-4702-929c-17c6676cdfae tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:30:00.034398 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-6a43263d-312a-4702-929c-17c6676cdfae tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:30:00.035191 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-6a43263d-312a-4702-929c-17c6676cdfae tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:30:00.035654 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-6a43263d-312a-4702-929c-17c6676cdfae tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:30:00.190095 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-6a43263d-312a-4702-929c-17c6676cdfae tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2c63ddb0134a3799806162af19c3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb29d996e3de41b0b21ee7ccd827eaea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:30:00.198219 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-6a43263d-312a-4702-929c-17c6676cdfae tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] 10.222.0.66 "GET /compute/v2.1/servers/059fc536-4c3e-42ae-889d-9d87177ef9dd" status: 200 len: 1266 microversion: 2.1 time: 0.178037 Nov 22 12:30:00.198863 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 594/1262] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:30:00 2021] GET /compute/v2.1/servers/059fc536-4c3e-42ae-889d-9d87177ef9dd => generated 1266 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:30:01.215777 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-44f8988e-4107-4be3-94bf-48843c089616 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:30:01.216382 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-44f8988e-4107-4be3-94bf-48843c089616 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] [instance: 059fc536-4c3e-42ae-889d-9d87177ef9dd] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:30:01.223993 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-44f8988e-4107-4be3-94bf-48843c089616 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:30:01.224540 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-44f8988e-4107-4be3-94bf-48843c089616 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:30:01.225395 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-44f8988e-4107-4be3-94bf-48843c089616 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:30:01.225866 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-44f8988e-4107-4be3-94bf-48843c089616 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:30:01.380816 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-44f8988e-4107-4be3-94bf-48843c089616 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2c63ddb0134a3799806162af19c3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb29d996e3de41b0b21ee7ccd827eaea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:30:01.389008 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-44f8988e-4107-4be3-94bf-48843c089616 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] 10.222.0.66 "GET /compute/v2.1/servers/059fc536-4c3e-42ae-889d-9d87177ef9dd" status: 200 len: 1266 microversion: 2.1 time: 0.176956 Nov 22 12:30:01.389594 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 669/1263] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:30:01 2021] GET /compute/v2.1/servers/059fc536-4c3e-42ae-889d-9d87177ef9dd => generated 1266 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:30:02.406700 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-3d0b6d7e-61ef-4125-ab1b-bd831e73fc08 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:30:02.407344 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-3d0b6d7e-61ef-4125-ab1b-bd831e73fc08 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] [instance: 059fc536-4c3e-42ae-889d-9d87177ef9dd] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:30:02.415569 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-3d0b6d7e-61ef-4125-ab1b-bd831e73fc08 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:30:02.416069 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-3d0b6d7e-61ef-4125-ab1b-bd831e73fc08 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:30:02.416855 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-3d0b6d7e-61ef-4125-ab1b-bd831e73fc08 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:30:02.417310 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-3d0b6d7e-61ef-4125-ab1b-bd831e73fc08 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:30:02.566185 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-3d0b6d7e-61ef-4125-ab1b-bd831e73fc08 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2c63ddb0134a3799806162af19c3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb29d996e3de41b0b21ee7ccd827eaea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:30:02.573861 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-3d0b6d7e-61ef-4125-ab1b-bd831e73fc08 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] 10.222.0.66 "GET /compute/v2.1/servers/059fc536-4c3e-42ae-889d-9d87177ef9dd" status: 200 len: 1266 microversion: 2.1 time: 0.171169 Nov 22 12:30:02.574514 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 595/1264] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:30:02 2021] GET /compute/v2.1/servers/059fc536-4c3e-42ae-889d-9d87177ef9dd => generated 1266 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:30:03.591930 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-f79110b8-66a1-4bde-82cd-6b484be9d08c tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:30:03.592522 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-f79110b8-66a1-4bde-82cd-6b484be9d08c tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] [instance: 059fc536-4c3e-42ae-889d-9d87177ef9dd] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:30:03.599193 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-f79110b8-66a1-4bde-82cd-6b484be9d08c tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:30:03.599678 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-f79110b8-66a1-4bde-82cd-6b484be9d08c tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:30:03.600467 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-f79110b8-66a1-4bde-82cd-6b484be9d08c tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:30:03.600899 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-f79110b8-66a1-4bde-82cd-6b484be9d08c tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:30:03.744999 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-f79110b8-66a1-4bde-82cd-6b484be9d08c tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2c63ddb0134a3799806162af19c3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb29d996e3de41b0b21ee7ccd827eaea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:30:03.754279 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-f79110b8-66a1-4bde-82cd-6b484be9d08c tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] 10.222.0.66 "GET /compute/v2.1/servers/059fc536-4c3e-42ae-889d-9d87177ef9dd" status: 200 len: 1266 microversion: 2.1 time: 0.166764 Nov 22 12:30:03.754869 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 670/1265] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:30:03 2021] GET /compute/v2.1/servers/059fc536-4c3e-42ae-889d-9d87177ef9dd => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:30:04.774637 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-fa02c09e-6796-4b28-8d44-c907c63906ce tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:30:04.775545 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-fa02c09e-6796-4b28-8d44-c907c63906ce tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] [instance: 059fc536-4c3e-42ae-889d-9d87177ef9dd] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:30:04.783560 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-fa02c09e-6796-4b28-8d44-c907c63906ce tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:30:04.784037 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-fa02c09e-6796-4b28-8d44-c907c63906ce tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:30:04.785180 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-fa02c09e-6796-4b28-8d44-c907c63906ce tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:30:04.785645 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-fa02c09e-6796-4b28-8d44-c907c63906ce tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:30:04.982122 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-fa02c09e-6796-4b28-8d44-c907c63906ce tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2c63ddb0134a3799806162af19c3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb29d996e3de41b0b21ee7ccd827eaea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:30:04.993616 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-fa02c09e-6796-4b28-8d44-c907c63906ce tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] 10.222.0.66 "GET /compute/v2.1/servers/059fc536-4c3e-42ae-889d-9d87177ef9dd" status: 200 len: 1266 microversion: 2.1 time: 0.223573 Nov 22 12:30:04.994485 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 596/1266] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:30:04 2021] GET /compute/v2.1/servers/059fc536-4c3e-42ae-889d-9d87177ef9dd => generated 1266 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:30:06.017794 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-b168818b-f425-406a-9037-8b8b11e84e5e tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:30:06.018426 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-b168818b-f425-406a-9037-8b8b11e84e5e tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] [instance: 059fc536-4c3e-42ae-889d-9d87177ef9dd] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:30:06.025331 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-b168818b-f425-406a-9037-8b8b11e84e5e tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:30:06.025785 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-b168818b-f425-406a-9037-8b8b11e84e5e tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:30:06.026577 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-b168818b-f425-406a-9037-8b8b11e84e5e tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:30:06.027011 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-b168818b-f425-406a-9037-8b8b11e84e5e tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:30:06.171118 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-b168818b-f425-406a-9037-8b8b11e84e5e tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2c63ddb0134a3799806162af19c3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb29d996e3de41b0b21ee7ccd827eaea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:30:06.179550 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-b168818b-f425-406a-9037-8b8b11e84e5e tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] 10.222.0.66 "GET /compute/v2.1/servers/059fc536-4c3e-42ae-889d-9d87177ef9dd" status: 200 len: 1266 microversion: 2.1 time: 0.165409 Nov 22 12:30:06.180191 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 671/1267] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:30:06 2021] GET /compute/v2.1/servers/059fc536-4c3e-42ae-889d-9d87177ef9dd => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:30:07.197804 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-2702dbbc-467f-4fb6-8b39-1bf698967a6e tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:30:07.198421 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-2702dbbc-467f-4fb6-8b39-1bf698967a6e tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] [instance: 059fc536-4c3e-42ae-889d-9d87177ef9dd] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:30:07.205231 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-2702dbbc-467f-4fb6-8b39-1bf698967a6e tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:30:07.205682 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-2702dbbc-467f-4fb6-8b39-1bf698967a6e tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:30:07.206483 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-2702dbbc-467f-4fb6-8b39-1bf698967a6e tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:30:07.206914 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-2702dbbc-467f-4fb6-8b39-1bf698967a6e tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:30:07.350031 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-2702dbbc-467f-4fb6-8b39-1bf698967a6e tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2c63ddb0134a3799806162af19c3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb29d996e3de41b0b21ee7ccd827eaea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:30:07.358110 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-2702dbbc-467f-4fb6-8b39-1bf698967a6e tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] 10.222.0.66 "GET /compute/v2.1/servers/059fc536-4c3e-42ae-889d-9d87177ef9dd" status: 200 len: 1266 microversion: 2.1 time: 0.164095 Nov 22 12:30:07.358713 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 597/1268] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:30:07 2021] GET /compute/v2.1/servers/059fc536-4c3e-42ae-889d-9d87177ef9dd => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:30:08.375697 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-1bde02c3-a8fd-4cc5-b822-029f52d98e11 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:30:08.376338 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-1bde02c3-a8fd-4cc5-b822-029f52d98e11 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] [instance: 059fc536-4c3e-42ae-889d-9d87177ef9dd] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:30:08.383369 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-1bde02c3-a8fd-4cc5-b822-029f52d98e11 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:30:08.383828 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-1bde02c3-a8fd-4cc5-b822-029f52d98e11 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:30:08.384615 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-1bde02c3-a8fd-4cc5-b822-029f52d98e11 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:30:08.385043 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-1bde02c3-a8fd-4cc5-b822-029f52d98e11 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:30:08.549049 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-1bde02c3-a8fd-4cc5-b822-029f52d98e11 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2c63ddb0134a3799806162af19c3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb29d996e3de41b0b21ee7ccd827eaea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:30:08.560670 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-1bde02c3-a8fd-4cc5-b822-029f52d98e11 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] 10.222.0.66 "GET /compute/v2.1/servers/059fc536-4c3e-42ae-889d-9d87177ef9dd" status: 200 len: 1266 microversion: 2.1 time: 0.189031 Nov 22 12:30:08.561470 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 672/1269] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:30:08 2021] GET /compute/v2.1/servers/059fc536-4c3e-42ae-889d-9d87177ef9dd => generated 1266 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:30:08.932314 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [req-59166dce-a12d-4147-a72d-3a66cc1642f9 req-01238970-7126-4d4a-aac4-81ddd8034a5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "059fc536-4c3e-42ae-889d-9d87177ef9dd", "name": "network-vif-plugged", "status": "completed", "tag": "33464858-d2a4-4a97-b98e-ab0137a739a1"}]} {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:30:08.933860 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 12:30:08.933860 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: warnings.warn(msg) Nov 22 12:30:08.941566 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [req-59166dce-a12d-4147-a72d-3a66cc1642f9 req-01238970-7126-4d4a-aac4-81ddd8034a5d service nova] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:30:08.942550 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [req-59166dce-a12d-4147-a72d-3a66cc1642f9 req-01238970-7126-4d4a-aac4-81ddd8034a5d service nova] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:30:08.955802 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.compute.server_external_events [req-59166dce-a12d-4147-a72d-3a66cc1642f9 req-01238970-7126-4d4a-aac4-81ddd8034a5d service nova] Creating event network-vif-plugged:33464858-d2a4-4a97-b98e-ab0137a739a1 for instance 059fc536-4c3e-42ae-889d-9d87177ef9dd on hv-cinder-76845 Nov 22 12:30:08.960837 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [req-59166dce-a12d-4147-a72d-3a66cc1642f9 req-01238970-7126-4d4a-aac4-81ddd8034a5d service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032377 Nov 22 12:30:08.961582 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 598/1270] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Nov 22 12:30:08 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 12:30:09.582564 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-c6c3d384-547b-432c-9a85-072016f81fff tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:30:09.583265 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-c6c3d384-547b-432c-9a85-072016f81fff tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] [instance: 059fc536-4c3e-42ae-889d-9d87177ef9dd] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:30:09.590257 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-c6c3d384-547b-432c-9a85-072016f81fff tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:30:09.590712 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-c6c3d384-547b-432c-9a85-072016f81fff tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:30:09.591568 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-c6c3d384-547b-432c-9a85-072016f81fff tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:30:09.591996 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-c6c3d384-547b-432c-9a85-072016f81fff tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:30:09.745468 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-c6c3d384-547b-432c-9a85-072016f81fff tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2c63ddb0134a3799806162af19c3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb29d996e3de41b0b21ee7ccd827eaea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:30:09.753019 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-c6c3d384-547b-432c-9a85-072016f81fff tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] 10.222.0.66 "GET /compute/v2.1/servers/059fc536-4c3e-42ae-889d-9d87177ef9dd" status: 200 len: 1266 microversion: 2.1 time: 0.174304 Nov 22 12:30:09.753590 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 673/1271] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:30:09 2021] GET /compute/v2.1/servers/059fc536-4c3e-42ae-889d-9d87177ef9dd => generated 1266 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:30:10.775609 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-9d07ab7e-0f9d-4691-b688-2a0eb43a6d06 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:30:10.776687 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-9d07ab7e-0f9d-4691-b688-2a0eb43a6d06 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] [instance: 059fc536-4c3e-42ae-889d-9d87177ef9dd] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:30:10.788202 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-9d07ab7e-0f9d-4691-b688-2a0eb43a6d06 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:30:10.788895 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-9d07ab7e-0f9d-4691-b688-2a0eb43a6d06 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:30:10.790145 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-9d07ab7e-0f9d-4691-b688-2a0eb43a6d06 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:30:10.790824 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-9d07ab7e-0f9d-4691-b688-2a0eb43a6d06 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:30:10.948930 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-9d07ab7e-0f9d-4691-b688-2a0eb43a6d06 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2c63ddb0134a3799806162af19c3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb29d996e3de41b0b21ee7ccd827eaea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:30:10.957632 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-9d07ab7e-0f9d-4691-b688-2a0eb43a6d06 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] 10.222.0.66 "GET /compute/v2.1/servers/059fc536-4c3e-42ae-889d-9d87177ef9dd" status: 200 len: 1453 microversion: 2.1 time: 0.188974 Nov 22 12:30:10.958188 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 599/1272] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:30:10 2021] GET /compute/v2.1/servers/059fc536-4c3e-42ae-889d-9d87177ef9dd => generated 1453 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:30:10.973701 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-8af2b7b3-23ce-413c-a6e2-b7b19c1be8bd tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:30:10.974343 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-8af2b7b3-23ce-413c-a6e2-b7b19c1be8bd tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] [instance: 059fc536-4c3e-42ae-889d-9d87177ef9dd] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:30:10.980802 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-8af2b7b3-23ce-413c-a6e2-b7b19c1be8bd tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:30:10.981243 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-8af2b7b3-23ce-413c-a6e2-b7b19c1be8bd tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:30:10.982017 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-8af2b7b3-23ce-413c-a6e2-b7b19c1be8bd tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:30:10.982606 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-8af2b7b3-23ce-413c-a6e2-b7b19c1be8bd tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:30:11.144272 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-8af2b7b3-23ce-413c-a6e2-b7b19c1be8bd tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2c63ddb0134a3799806162af19c3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb29d996e3de41b0b21ee7ccd827eaea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:30:11.155438 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-8af2b7b3-23ce-413c-a6e2-b7b19c1be8bd tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] 10.222.0.66 "GET /compute/v2.1/servers/059fc536-4c3e-42ae-889d-9d87177ef9dd" status: 200 len: 1453 microversion: 2.1 time: 0.185286 Nov 22 12:30:11.155984 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 674/1273] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:30:10 2021] GET /compute/v2.1/servers/059fc536-4c3e-42ae-889d-9d87177ef9dd => generated 1453 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:30:12.934619 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [req-f9f0e392-4d64-49b7-8158-d8d727aa7a71 req-5cdcfbfa-c113-4a06-884a-c2771ca46d81 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "059fc536-4c3e-42ae-889d-9d87177ef9dd", "tag": "33464858-d2a4-4a97-b98e-ab0137a739a1"}]} {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:30:12.936400 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 12:30:12.936400 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: warnings.warn(msg) Nov 22 12:30:12.944259 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [req-f9f0e392-4d64-49b7-8158-d8d727aa7a71 req-5cdcfbfa-c113-4a06-884a-c2771ca46d81 service nova] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:30:12.944793 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [req-f9f0e392-4d64-49b7-8158-d8d727aa7a71 req-5cdcfbfa-c113-4a06-884a-c2771ca46d81 service nova] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:30:12.957088 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.compute.server_external_events [req-f9f0e392-4d64-49b7-8158-d8d727aa7a71 req-5cdcfbfa-c113-4a06-884a-c2771ca46d81 service nova] Creating event network-changed:33464858-d2a4-4a97-b98e-ab0137a739a1 for instance 059fc536-4c3e-42ae-889d-9d87177ef9dd on hv-cinder-76845 Nov 22 12:30:12.963017 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [req-f9f0e392-4d64-49b7-8158-d8d727aa7a71 req-5cdcfbfa-c113-4a06-884a-c2771ca46d81 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040053 Nov 22 12:30:12.963939 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 600/1274] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Nov 22 12:30:12 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 12:30:48.985963 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 22 12:30:48.986542 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: Mon Nov 22 12:30:48 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 22 12:31:53.048599 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-93980194-c1fd-4b6b-bf3c-39b4f119f037 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1030519499", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-250070142", "security_groups": [{"name": "tempest-secgroup-smoke-1723309336"}], "block_device_mapping_v2": [{"uuid": "82ca8a14-c228-4c69-878c-fd637abfc784", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "b3fc06d8-5c3b-4a4b-b823-0fcbe71895b9"}]}} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:31:53.163516 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.network.neutron [None req-93980194-c1fd-4b6b-bf3c-39b4f119f037 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] validate_networks() for [('b3fc06d8-5c3b-4a4b-b823-0fcbe71895b9', None, None, None, None, None)] {{(pid=116272) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 22 12:31:53.607822 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.virt.hardware [None req-93980194-c1fd-4b6b-bf3c-39b4f119f037 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Flavor limits 0:0:0 {{(pid=116272) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 22 12:31:53.608237 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.virt.hardware [None req-93980194-c1fd-4b6b-bf3c-39b4f119f037 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Image limits 0:0:0 {{(pid=116272) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 22 12:31:53.608701 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.virt.hardware [None req-93980194-c1fd-4b6b-bf3c-39b4f119f037 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Flavor pref 0:0:0 {{(pid=116272) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 22 12:31:53.609103 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.virt.hardware [None req-93980194-c1fd-4b6b-bf3c-39b4f119f037 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Image pref 0:0:0 {{(pid=116272) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 22 12:31:53.609507 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.virt.hardware [None req-93980194-c1fd-4b6b-bf3c-39b4f119f037 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116272) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 22 12:31:53.618662 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-93980194-c1fd-4b6b-bf3c-39b4f119f037 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:31:53.619092 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-93980194-c1fd-4b6b-bf3c-39b4f119f037 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:31:53.619929 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-93980194-c1fd-4b6b-bf3c-39b4f119f037 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:31:53.620363 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-93980194-c1fd-4b6b-bf3c-39b4f119f037 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:31:53.637393 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.quota [None req-93980194-c1fd-4b6b-bf3c-39b4f119f037 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Getting quotas for project cb29d996e3de41b0b21ee7ccd827eaea. Resources: {'ram', 'instances', 'cores'} {{(pid=116272) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 22 12:31:53.641834 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.quota [None req-93980194-c1fd-4b6b-bf3c-39b4f119f037 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Getting quotas for user bf2c63ddb0134a3799806162af19c3b5 and project cb29d996e3de41b0b21ee7ccd827eaea. Resources: {'ram', 'instances', 'cores'} {{(pid=116272) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 22 12:31:53.707274 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-93980194-c1fd-4b6b-bf3c-39b4f119f037 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Going to run 1 instances... {{(pid=116272) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 22 12:31:53.709480 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-93980194-c1fd-4b6b-bf3c-39b4f119f037 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] [instance: 9d7ed4dd-cb0a-4e54-94b7-28eb4826ef5c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='82ca8a14-c228-4c69-878c-fd637abfc784',volume_size=None,volume_type=None)] {{(pid=116272) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 22 12:31:53.860261 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-93980194-c1fd-4b6b-bf3c-39b4f119f037 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.816780 Nov 22 12:31:53.860912 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 675/1275] 10.222.0.66 () {60 vars in 1146 bytes} [Mon Nov 22 12:31:53 2021] POST /compute/v2.1/servers => generated 406 bytes in 818 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 22 12:31:53.869653 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ecdb9255-927f-46a2-ae36-46cae060eea1] AMQP server on 10.222.0.66:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 22 12:31:53.875045 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-5d868234-e3f2-4e75-89cb-7726f2e47e69 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:31:53.875972 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-5d868234-e3f2-4e75-89cb-7726f2e47e69 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] [instance: 9d7ed4dd-cb0a-4e54-94b7-28eb4826ef5c] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:31:53.934064 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-5d868234-e3f2-4e75-89cb-7726f2e47e69 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2c63ddb0134a3799806162af19c3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb29d996e3de41b0b21ee7ccd827eaea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:31:53.941113 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-5d868234-e3f2-4e75-89cb-7726f2e47e69 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] 10.222.0.66 "GET /compute/v2.1/servers/9d7ed4dd-cb0a-4e54-94b7-28eb4826ef5c" status: 200 len: 1094 microversion: 2.1 time: 0.073463 Nov 22 12:31:53.941700 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 601/1276] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:31:53 2021] GET /compute/v2.1/servers/9d7ed4dd-cb0a-4e54-94b7-28eb4826ef5c => generated 1094 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:31:54.955491 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: ERROR oslo.messaging._drivers.impl_rabbit [-] [97abf195-4e65-4295-9c8f-9273ad1c4535] AMQP server on 10.222.0.66:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 22 12:31:54.958907 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-58895595-8ef0-429e-acd3-84ecbdf16f3b tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:31:54.959549 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-58895595-8ef0-429e-acd3-84ecbdf16f3b tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] [instance: 9d7ed4dd-cb0a-4e54-94b7-28eb4826ef5c] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:31:54.965757 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-58895595-8ef0-429e-acd3-84ecbdf16f3b tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:31:54.966212 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-58895595-8ef0-429e-acd3-84ecbdf16f3b tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:31:54.967027 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-58895595-8ef0-429e-acd3-84ecbdf16f3b tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:31:54.967510 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-58895595-8ef0-429e-acd3-84ecbdf16f3b tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:31:55.072105 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-58895595-8ef0-429e-acd3-84ecbdf16f3b tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2c63ddb0134a3799806162af19c3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb29d996e3de41b0b21ee7ccd827eaea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:31:55.080093 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-58895595-8ef0-429e-acd3-84ecbdf16f3b tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] 10.222.0.66 "GET /compute/v2.1/servers/9d7ed4dd-cb0a-4e54-94b7-28eb4826ef5c" status: 200 len: 1210 microversion: 2.1 time: 0.125826 Nov 22 12:31:55.080683 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 676/1277] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:31:54 2021] GET /compute/v2.1/servers/9d7ed4dd-cb0a-4e54-94b7-28eb4826ef5c => generated 1210 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:31:56.101941 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-25d83c10-c2a3-45bf-bdc5-54c7c7f24b3a tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:31:56.102578 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-25d83c10-c2a3-45bf-bdc5-54c7c7f24b3a tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] [instance: 9d7ed4dd-cb0a-4e54-94b7-28eb4826ef5c] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:31:56.125287 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO oslo.messaging._drivers.impl_rabbit [-] [ecdb9255-927f-46a2-ae36-46cae060eea1] Reconnected to AMQP server on 10.222.0.66:5672 via [amqp] client with port 45306. Nov 22 12:31:56.130895 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-25d83c10-c2a3-45bf-bdc5-54c7c7f24b3a tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:31:56.131359 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-25d83c10-c2a3-45bf-bdc5-54c7c7f24b3a tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:31:56.132213 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-25d83c10-c2a3-45bf-bdc5-54c7c7f24b3a tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:31:56.132696 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-25d83c10-c2a3-45bf-bdc5-54c7c7f24b3a tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:31:56.384662 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO oslo.messaging._drivers.impl_rabbit [-] [97abf195-4e65-4295-9c8f-9273ad1c4535] Reconnected to AMQP server on 10.222.0.66:5672 via [amqp] client with port 45312. Nov 22 12:31:56.391078 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-25d83c10-c2a3-45bf-bdc5-54c7c7f24b3a tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2c63ddb0134a3799806162af19c3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb29d996e3de41b0b21ee7ccd827eaea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:31:56.403971 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-25d83c10-c2a3-45bf-bdc5-54c7c7f24b3a tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] 10.222.0.66 "GET /compute/v2.1/servers/9d7ed4dd-cb0a-4e54-94b7-28eb4826ef5c" status: 200 len: 1266 microversion: 2.1 time: 0.305670 Nov 22 12:31:56.404919 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 602/1278] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:31:56 2021] GET /compute/v2.1/servers/9d7ed4dd-cb0a-4e54-94b7-28eb4826ef5c => generated 1266 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:31:56.532321 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [req-40491a82-6dd2-42b4-b0cc-4f918f3c247e req-ab3665e7-d7d9-43a1-a655-c7e9e50cc2e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d7ed4dd-cb0a-4e54-94b7-28eb4826ef5c", "tag": "d15fb1fe-de3e-49de-a037-e523ad429758"}]} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:31:56.533895 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 12:31:56.533895 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: warnings.warn(msg) Nov 22 12:31:56.541381 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [req-40491a82-6dd2-42b4-b0cc-4f918f3c247e req-ab3665e7-d7d9-43a1-a655-c7e9e50cc2e2 service nova] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:31:56.541800 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [req-40491a82-6dd2-42b4-b0cc-4f918f3c247e req-ab3665e7-d7d9-43a1-a655-c7e9e50cc2e2 service nova] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:31:56.554004 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.compute.server_external_events [req-40491a82-6dd2-42b4-b0cc-4f918f3c247e req-ab3665e7-d7d9-43a1-a655-c7e9e50cc2e2 service nova] Creating event network-changed:d15fb1fe-de3e-49de-a037-e523ad429758 for instance 9d7ed4dd-cb0a-4e54-94b7-28eb4826ef5c on hv-cinder-76845 Nov 22 12:31:56.559382 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [req-40491a82-6dd2-42b4-b0cc-4f918f3c247e req-ab3665e7-d7d9-43a1-a655-c7e9e50cc2e2 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.228522 Nov 22 12:31:56.561073 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 677/1279] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Nov 22 12:31:56 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 22 12:31:57.424124 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-237191b2-04ae-4466-9700-80618119a1f5 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:31:57.425529 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-237191b2-04ae-4466-9700-80618119a1f5 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] [instance: 9d7ed4dd-cb0a-4e54-94b7-28eb4826ef5c] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:31:57.436874 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-237191b2-04ae-4466-9700-80618119a1f5 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:31:57.437416 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-237191b2-04ae-4466-9700-80618119a1f5 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:31:57.438195 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-237191b2-04ae-4466-9700-80618119a1f5 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:31:57.438620 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-237191b2-04ae-4466-9700-80618119a1f5 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:31:57.581780 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-237191b2-04ae-4466-9700-80618119a1f5 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2c63ddb0134a3799806162af19c3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb29d996e3de41b0b21ee7ccd827eaea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:31:57.589971 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-237191b2-04ae-4466-9700-80618119a1f5 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] 10.222.0.66 "GET /compute/v2.1/servers/9d7ed4dd-cb0a-4e54-94b7-28eb4826ef5c" status: 200 len: 1266 microversion: 2.1 time: 0.171719 Nov 22 12:31:57.590877 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 603/1280] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:31:57 2021] GET /compute/v2.1/servers/9d7ed4dd-cb0a-4e54-94b7-28eb4826ef5c => generated 1266 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:31:58.609899 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-1cb91def-c09c-49f4-89b7-2fa7060500c7 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:31:58.617298 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-1cb91def-c09c-49f4-89b7-2fa7060500c7 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] [instance: 9d7ed4dd-cb0a-4e54-94b7-28eb4826ef5c] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:31:58.625022 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-1cb91def-c09c-49f4-89b7-2fa7060500c7 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:31:58.625670 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-1cb91def-c09c-49f4-89b7-2fa7060500c7 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:31:58.626501 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-1cb91def-c09c-49f4-89b7-2fa7060500c7 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:31:58.627046 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-1cb91def-c09c-49f4-89b7-2fa7060500c7 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:31:58.793222 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-1cb91def-c09c-49f4-89b7-2fa7060500c7 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2c63ddb0134a3799806162af19c3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb29d996e3de41b0b21ee7ccd827eaea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:31:58.802034 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-1cb91def-c09c-49f4-89b7-2fa7060500c7 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] 10.222.0.66 "GET /compute/v2.1/servers/9d7ed4dd-cb0a-4e54-94b7-28eb4826ef5c" status: 200 len: 1266 microversion: 2.1 time: 0.197059 Nov 22 12:31:58.802551 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 678/1281] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:31:58 2021] GET /compute/v2.1/servers/9d7ed4dd-cb0a-4e54-94b7-28eb4826ef5c => generated 1266 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:31:59.820642 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-44acc72f-8108-478b-82fa-cf6576d89afb tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:31:59.821274 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-44acc72f-8108-478b-82fa-cf6576d89afb tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] [instance: 9d7ed4dd-cb0a-4e54-94b7-28eb4826ef5c] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:31:59.828393 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-44acc72f-8108-478b-82fa-cf6576d89afb tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:31:59.828840 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-44acc72f-8108-478b-82fa-cf6576d89afb tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:31:59.829628 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-44acc72f-8108-478b-82fa-cf6576d89afb tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:31:59.830058 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-44acc72f-8108-478b-82fa-cf6576d89afb tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:31:59.979440 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-44acc72f-8108-478b-82fa-cf6576d89afb tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2c63ddb0134a3799806162af19c3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb29d996e3de41b0b21ee7ccd827eaea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:31:59.987829 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-44acc72f-8108-478b-82fa-cf6576d89afb tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] 10.222.0.66 "GET /compute/v2.1/servers/9d7ed4dd-cb0a-4e54-94b7-28eb4826ef5c" status: 200 len: 1266 microversion: 2.1 time: 0.171011 Nov 22 12:31:59.988414 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 604/1282] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:31:59 2021] GET /compute/v2.1/servers/9d7ed4dd-cb0a-4e54-94b7-28eb4826ef5c => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:32:01.007175 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-b269e384-6d9d-4e94-8807-d310516fbab1 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:32:01.007804 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-b269e384-6d9d-4e94-8807-d310516fbab1 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] [instance: 9d7ed4dd-cb0a-4e54-94b7-28eb4826ef5c] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:32:01.016352 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-b269e384-6d9d-4e94-8807-d310516fbab1 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:32:01.016799 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-b269e384-6d9d-4e94-8807-d310516fbab1 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:32:01.017576 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-b269e384-6d9d-4e94-8807-d310516fbab1 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:32:01.018000 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-b269e384-6d9d-4e94-8807-d310516fbab1 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:32:01.172919 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-b269e384-6d9d-4e94-8807-d310516fbab1 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2c63ddb0134a3799806162af19c3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb29d996e3de41b0b21ee7ccd827eaea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:32:01.182123 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-b269e384-6d9d-4e94-8807-d310516fbab1 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] 10.222.0.66 "GET /compute/v2.1/servers/9d7ed4dd-cb0a-4e54-94b7-28eb4826ef5c" status: 200 len: 1266 microversion: 2.1 time: 0.180357 Nov 22 12:32:01.183037 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 679/1283] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:32:01 2021] GET /compute/v2.1/servers/9d7ed4dd-cb0a-4e54-94b7-28eb4826ef5c => generated 1266 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:32:02.200625 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-4e20c347-75b0-4465-8fee-2eefd1a5a48a tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:32:02.201263 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-4e20c347-75b0-4465-8fee-2eefd1a5a48a tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] [instance: 9d7ed4dd-cb0a-4e54-94b7-28eb4826ef5c] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:32:02.208456 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-4e20c347-75b0-4465-8fee-2eefd1a5a48a tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:32:02.208901 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-4e20c347-75b0-4465-8fee-2eefd1a5a48a tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:32:02.209680 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-4e20c347-75b0-4465-8fee-2eefd1a5a48a tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:32:02.210107 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-4e20c347-75b0-4465-8fee-2eefd1a5a48a tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:32:02.360150 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-4e20c347-75b0-4465-8fee-2eefd1a5a48a tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2c63ddb0134a3799806162af19c3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb29d996e3de41b0b21ee7ccd827eaea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:32:02.368457 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-4e20c347-75b0-4465-8fee-2eefd1a5a48a tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] 10.222.0.66 "GET /compute/v2.1/servers/9d7ed4dd-cb0a-4e54-94b7-28eb4826ef5c" status: 200 len: 1266 microversion: 2.1 time: 0.171561 Nov 22 12:32:02.369030 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 605/1284] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:32:02 2021] GET /compute/v2.1/servers/9d7ed4dd-cb0a-4e54-94b7-28eb4826ef5c => generated 1266 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:32:03.388090 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-7b029008-e107-4c28-9bca-46988cdc9896 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:32:03.388725 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-7b029008-e107-4c28-9bca-46988cdc9896 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] [instance: 9d7ed4dd-cb0a-4e54-94b7-28eb4826ef5c] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:32:03.398252 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-7b029008-e107-4c28-9bca-46988cdc9896 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:32:03.398701 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-7b029008-e107-4c28-9bca-46988cdc9896 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:32:03.399868 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-7b029008-e107-4c28-9bca-46988cdc9896 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:32:03.400350 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-7b029008-e107-4c28-9bca-46988cdc9896 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:32:03.546966 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-7b029008-e107-4c28-9bca-46988cdc9896 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2c63ddb0134a3799806162af19c3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb29d996e3de41b0b21ee7ccd827eaea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:32:03.558537 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-7b029008-e107-4c28-9bca-46988cdc9896 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] 10.222.0.66 "GET /compute/v2.1/servers/9d7ed4dd-cb0a-4e54-94b7-28eb4826ef5c" status: 200 len: 1266 microversion: 2.1 time: 0.175703 Nov 22 12:32:03.559303 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 680/1285] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:32:03 2021] GET /compute/v2.1/servers/9d7ed4dd-cb0a-4e54-94b7-28eb4826ef5c => generated 1266 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:32:04.578409 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-cd2f40d5-759c-4680-b15b-8c577f8d01f3 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:32:04.579047 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-cd2f40d5-759c-4680-b15b-8c577f8d01f3 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] [instance: 9d7ed4dd-cb0a-4e54-94b7-28eb4826ef5c] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:32:04.585787 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-cd2f40d5-759c-4680-b15b-8c577f8d01f3 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:32:04.586243 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-cd2f40d5-759c-4680-b15b-8c577f8d01f3 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:32:04.587030 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-cd2f40d5-759c-4680-b15b-8c577f8d01f3 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:32:04.587505 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-cd2f40d5-759c-4680-b15b-8c577f8d01f3 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:32:04.627905 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 22 12:32:04.628510 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: Mon Nov 22 12:32:04 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 22 12:32:04.730238 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-cd2f40d5-759c-4680-b15b-8c577f8d01f3 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2c63ddb0134a3799806162af19c3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb29d996e3de41b0b21ee7ccd827eaea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:32:04.738925 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-cd2f40d5-759c-4680-b15b-8c577f8d01f3 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] 10.222.0.66 "GET /compute/v2.1/servers/9d7ed4dd-cb0a-4e54-94b7-28eb4826ef5c" status: 200 len: 1266 microversion: 2.1 time: 0.166167 Nov 22 12:32:04.739612 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 606/1286] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:32:04 2021] GET /compute/v2.1/servers/9d7ed4dd-cb0a-4e54-94b7-28eb4826ef5c => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:32:05.756269 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-c3b50b78-7776-4f3d-90d8-744e971f662c tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:32:05.756875 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-c3b50b78-7776-4f3d-90d8-744e971f662c tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] [instance: 9d7ed4dd-cb0a-4e54-94b7-28eb4826ef5c] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:32:05.763692 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-c3b50b78-7776-4f3d-90d8-744e971f662c tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:32:05.764158 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-c3b50b78-7776-4f3d-90d8-744e971f662c tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:32:05.764930 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-c3b50b78-7776-4f3d-90d8-744e971f662c tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:32:05.765363 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-c3b50b78-7776-4f3d-90d8-744e971f662c tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:32:05.926111 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-c3b50b78-7776-4f3d-90d8-744e971f662c tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2c63ddb0134a3799806162af19c3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb29d996e3de41b0b21ee7ccd827eaea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:32:05.939053 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-c3b50b78-7776-4f3d-90d8-744e971f662c tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] 10.222.0.66 "GET /compute/v2.1/servers/9d7ed4dd-cb0a-4e54-94b7-28eb4826ef5c" status: 200 len: 1266 microversion: 2.1 time: 0.186125 Nov 22 12:32:05.939831 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 681/1287] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:32:05 2021] GET /compute/v2.1/servers/9d7ed4dd-cb0a-4e54-94b7-28eb4826ef5c => generated 1266 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:32:06.960277 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-7f3e6e9f-7af9-404f-8813-588cdd026fdf tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:32:06.961257 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-7f3e6e9f-7af9-404f-8813-588cdd026fdf tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] [instance: 9d7ed4dd-cb0a-4e54-94b7-28eb4826ef5c] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:32:06.968205 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-7f3e6e9f-7af9-404f-8813-588cdd026fdf tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:32:06.968676 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-7f3e6e9f-7af9-404f-8813-588cdd026fdf tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:32:06.969606 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-7f3e6e9f-7af9-404f-8813-588cdd026fdf tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:32:06.970071 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-7f3e6e9f-7af9-404f-8813-588cdd026fdf tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:32:07.132885 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-7f3e6e9f-7af9-404f-8813-588cdd026fdf tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2c63ddb0134a3799806162af19c3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb29d996e3de41b0b21ee7ccd827eaea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:32:07.141130 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-7f3e6e9f-7af9-404f-8813-588cdd026fdf tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] 10.222.0.66 "GET /compute/v2.1/servers/9d7ed4dd-cb0a-4e54-94b7-28eb4826ef5c" status: 200 len: 1266 microversion: 2.1 time: 0.185051 Nov 22 12:32:07.142492 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 607/1288] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:32:06 2021] GET /compute/v2.1/servers/9d7ed4dd-cb0a-4e54-94b7-28eb4826ef5c => generated 1266 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:32:07.739015 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [req-39739cbe-4003-42cb-a841-19c3e1f560bf req-b35c4db8-1e5d-4a9e-9790-99ca8cbb2486 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d7ed4dd-cb0a-4e54-94b7-28eb4826ef5c", "name": "network-vif-plugged", "status": "completed", "tag": "d15fb1fe-de3e-49de-a037-e523ad429758"}]} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:32:07.740553 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 12:32:07.740553 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: warnings.warn(msg) Nov 22 12:32:07.747652 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [req-39739cbe-4003-42cb-a841-19c3e1f560bf req-b35c4db8-1e5d-4a9e-9790-99ca8cbb2486 service nova] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:32:07.748099 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [req-39739cbe-4003-42cb-a841-19c3e1f560bf req-b35c4db8-1e5d-4a9e-9790-99ca8cbb2486 service nova] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:32:07.759207 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.compute.server_external_events [req-39739cbe-4003-42cb-a841-19c3e1f560bf req-b35c4db8-1e5d-4a9e-9790-99ca8cbb2486 service nova] Creating event network-vif-plugged:d15fb1fe-de3e-49de-a037-e523ad429758 for instance 9d7ed4dd-cb0a-4e54-94b7-28eb4826ef5c on hv-cinder-76845 Nov 22 12:32:07.764392 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [req-39739cbe-4003-42cb-a841-19c3e1f560bf req-b35c4db8-1e5d-4a9e-9790-99ca8cbb2486 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098644 Nov 22 12:32:07.765032 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 682/1289] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Nov 22 12:32:07 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 12:32:08.160410 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-e95381b9-925b-4b39-9004-8580417a2fac tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:32:08.161338 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-e95381b9-925b-4b39-9004-8580417a2fac tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] [instance: 9d7ed4dd-cb0a-4e54-94b7-28eb4826ef5c] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:32:08.168198 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-e95381b9-925b-4b39-9004-8580417a2fac tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:32:08.168636 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-e95381b9-925b-4b39-9004-8580417a2fac tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:32:08.169441 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-e95381b9-925b-4b39-9004-8580417a2fac tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:32:08.169873 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-e95381b9-925b-4b39-9004-8580417a2fac tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:32:08.316840 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-e95381b9-925b-4b39-9004-8580417a2fac tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2c63ddb0134a3799806162af19c3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb29d996e3de41b0b21ee7ccd827eaea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:32:08.324337 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-e95381b9-925b-4b39-9004-8580417a2fac tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] 10.222.0.66 "GET /compute/v2.1/servers/9d7ed4dd-cb0a-4e54-94b7-28eb4826ef5c" status: 200 len: 1266 microversion: 2.1 time: 0.168191 Nov 22 12:32:08.324952 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 608/1290] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:32:08 2021] GET /compute/v2.1/servers/9d7ed4dd-cb0a-4e54-94b7-28eb4826ef5c => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:32:09.342636 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-0f1edc23-7de6-403b-829c-fe6838d90a3e tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:32:09.343369 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-0f1edc23-7de6-403b-829c-fe6838d90a3e tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] [instance: 9d7ed4dd-cb0a-4e54-94b7-28eb4826ef5c] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:32:09.350597 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-0f1edc23-7de6-403b-829c-fe6838d90a3e tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:32:09.351043 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-0f1edc23-7de6-403b-829c-fe6838d90a3e tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:32:09.351832 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-0f1edc23-7de6-403b-829c-fe6838d90a3e tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:32:09.352293 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-0f1edc23-7de6-403b-829c-fe6838d90a3e tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:32:09.500405 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-0f1edc23-7de6-403b-829c-fe6838d90a3e tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2c63ddb0134a3799806162af19c3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb29d996e3de41b0b21ee7ccd827eaea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:32:09.508526 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-0f1edc23-7de6-403b-829c-fe6838d90a3e tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] 10.222.0.66 "GET /compute/v2.1/servers/9d7ed4dd-cb0a-4e54-94b7-28eb4826ef5c" status: 200 len: 1453 microversion: 2.1 time: 0.170377 Nov 22 12:32:09.509067 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 683/1291] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:32:09 2021] GET /compute/v2.1/servers/9d7ed4dd-cb0a-4e54-94b7-28eb4826ef5c => generated 1453 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:32:09.524780 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-f803b1d5-e164-4a1f-adfb-d7d66154d696 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:32:09.525384 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-f803b1d5-e164-4a1f-adfb-d7d66154d696 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] [instance: 9d7ed4dd-cb0a-4e54-94b7-28eb4826ef5c] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:32:09.531869 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-f803b1d5-e164-4a1f-adfb-d7d66154d696 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:32:09.532317 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-f803b1d5-e164-4a1f-adfb-d7d66154d696 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:32:09.533089 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-f803b1d5-e164-4a1f-adfb-d7d66154d696 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:32:09.533522 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-f803b1d5-e164-4a1f-adfb-d7d66154d696 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:32:09.688968 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-f803b1d5-e164-4a1f-adfb-d7d66154d696 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2c63ddb0134a3799806162af19c3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb29d996e3de41b0b21ee7ccd827eaea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:32:09.697366 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-f803b1d5-e164-4a1f-adfb-d7d66154d696 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] 10.222.0.66 "GET /compute/v2.1/servers/9d7ed4dd-cb0a-4e54-94b7-28eb4826ef5c" status: 200 len: 1453 microversion: 2.1 time: 0.176212 Nov 22 12:32:09.697947 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 609/1292] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:32:09 2021] GET /compute/v2.1/servers/9d7ed4dd-cb0a-4e54-94b7-28eb4826ef5c => generated 1453 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:32:11.740687 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [req-bac163b2-281a-47f3-8c72-aaff9653da9b req-274a1bff-6188-4fbf-b037-f9f87cca295f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d7ed4dd-cb0a-4e54-94b7-28eb4826ef5c", "tag": "d15fb1fe-de3e-49de-a037-e523ad429758"}]} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:32:11.742199 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 12:32:11.742199 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: warnings.warn(msg) Nov 22 12:32:11.749723 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [req-bac163b2-281a-47f3-8c72-aaff9653da9b req-274a1bff-6188-4fbf-b037-f9f87cca295f service nova] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:32:11.750165 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [req-bac163b2-281a-47f3-8c72-aaff9653da9b req-274a1bff-6188-4fbf-b037-f9f87cca295f service nova] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:32:11.761691 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.compute.server_external_events [req-bac163b2-281a-47f3-8c72-aaff9653da9b req-274a1bff-6188-4fbf-b037-f9f87cca295f service nova] Creating event network-changed:d15fb1fe-de3e-49de-a037-e523ad429758 for instance 9d7ed4dd-cb0a-4e54-94b7-28eb4826ef5c on hv-cinder-76845 Nov 22 12:32:11.766785 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [req-bac163b2-281a-47f3-8c72-aaff9653da9b req-274a1bff-6188-4fbf-b037-f9f87cca295f service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029743 Nov 22 12:32:11.769778 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 684/1293] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Nov 22 12:32:11 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 12:32:30.694932 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 22 12:32:30.695602 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: Mon Nov 22 12:32:30 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 22 12:32:47.698785 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 22 12:32:47.699616 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: Mon Nov 22 12:32:47 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 22 12:32:49.341628 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 22 12:32:49.342361 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: Mon Nov 22 12:32:49 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 22 12:33:41.127375 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-c81bfa24-8e28-4758-aea5-ffcfbd8dbf51 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:33:41.128042 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-c81bfa24-8e28-4758-aea5-ffcfbd8dbf51 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] [instance: 9d7ed4dd-cb0a-4e54-94b7-28eb4826ef5c] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:33:41.132088 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [req-ab137779-9c35-4ce9-8cdb-714815312014 req-552486d8-49ba-4cea-9cef-6f569860c1a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d7ed4dd-cb0a-4e54-94b7-28eb4826ef5c", "tag": "d15fb1fe-de3e-49de-a037-e523ad429758"}]} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:33:41.133538 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 12:33:41.133538 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: warnings.warn(msg) Nov 22 12:33:41.134740 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-c81bfa24-8e28-4758-aea5-ffcfbd8dbf51 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:33:41.135170 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-c81bfa24-8e28-4758-aea5-ffcfbd8dbf51 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:33:41.136268 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-c81bfa24-8e28-4758-aea5-ffcfbd8dbf51 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:33:41.136695 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-c81bfa24-8e28-4758-aea5-ffcfbd8dbf51 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:33:41.141007 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [req-ab137779-9c35-4ce9-8cdb-714815312014 req-552486d8-49ba-4cea-9cef-6f569860c1a8 service nova] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:33:41.141842 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [req-ab137779-9c35-4ce9-8cdb-714815312014 req-552486d8-49ba-4cea-9cef-6f569860c1a8 service nova] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:33:41.153707 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.compute.server_external_events [req-ab137779-9c35-4ce9-8cdb-714815312014 req-552486d8-49ba-4cea-9cef-6f569860c1a8 service nova] Creating event network-changed:d15fb1fe-de3e-49de-a037-e523ad429758 for instance 9d7ed4dd-cb0a-4e54-94b7-28eb4826ef5c on hv-cinder-76845 Nov 22 12:33:41.158814 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [req-ab137779-9c35-4ce9-8cdb-714815312014 req-552486d8-49ba-4cea-9cef-6f569860c1a8 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033487 Nov 22 12:33:41.159793 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 685/1294] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Nov 22 12:33:41 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 12:33:41.163614 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-c81bfa24-8e28-4758-aea5-ffcfbd8dbf51 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] [instance: 9d7ed4dd-cb0a-4e54-94b7-28eb4826ef5c] Going to try to terminate instance {{(pid=116273) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 22 12:33:41.251284 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-c81bfa24-8e28-4758-aea5-ffcfbd8dbf51 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] 10.222.0.66 "DELETE /compute/v2.1/servers/9d7ed4dd-cb0a-4e54-94b7-28eb4826ef5c" status: 204 len: 0 microversion: 2.1 time: 0.129159 Nov 22 12:33:41.251919 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 610/1295] 10.222.0.66 () {58 vars in 1238 bytes} [Mon Nov 22 12:33:41 2021] DELETE /compute/v2.1/servers/9d7ed4dd-cb0a-4e54-94b7-28eb4826ef5c => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 22 12:33:41.261260 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-c8a3c671-c0f4-4234-b4b6-a8ff601f6c1c tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:33:41.261513 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-c8a3c671-c0f4-4234-b4b6-a8ff601f6c1c tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] [instance: 9d7ed4dd-cb0a-4e54-94b7-28eb4826ef5c] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:33:41.267844 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-c8a3c671-c0f4-4234-b4b6-a8ff601f6c1c tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:33:41.268281 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-c8a3c671-c0f4-4234-b4b6-a8ff601f6c1c tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:33:41.269116 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-c8a3c671-c0f4-4234-b4b6-a8ff601f6c1c tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:33:41.269556 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-c8a3c671-c0f4-4234-b4b6-a8ff601f6c1c tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:33:41.497733 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-c8a3c671-c0f4-4234-b4b6-a8ff601f6c1c tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2c63ddb0134a3799806162af19c3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb29d996e3de41b0b21ee7ccd827eaea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:33:41.506600 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-c8a3c671-c0f4-4234-b4b6-a8ff601f6c1c tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] 10.222.0.66 "GET /compute/v2.1/servers/9d7ed4dd-cb0a-4e54-94b7-28eb4826ef5c" status: 200 len: 1578 microversion: 2.1 time: 0.249885 Nov 22 12:33:41.507186 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 686/1296] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:33:41 2021] GET /compute/v2.1/servers/9d7ed4dd-cb0a-4e54-94b7-28eb4826ef5c => generated 1578 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 12:33:42.525059 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-193bf5ff-6dfc-4e3e-8086-3bfd3554450d tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:33:42.525759 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-193bf5ff-6dfc-4e3e-8086-3bfd3554450d tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] [instance: 9d7ed4dd-cb0a-4e54-94b7-28eb4826ef5c] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:33:42.532502 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-193bf5ff-6dfc-4e3e-8086-3bfd3554450d tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:33:42.532945 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-193bf5ff-6dfc-4e3e-8086-3bfd3554450d tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:33:42.533716 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-193bf5ff-6dfc-4e3e-8086-3bfd3554450d tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:33:42.534142 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-193bf5ff-6dfc-4e3e-8086-3bfd3554450d tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:33:42.693667 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-193bf5ff-6dfc-4e3e-8086-3bfd3554450d tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2c63ddb0134a3799806162af19c3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb29d996e3de41b0b21ee7ccd827eaea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:33:42.702675 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-193bf5ff-6dfc-4e3e-8086-3bfd3554450d tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] 10.222.0.66 "GET /compute/v2.1/servers/9d7ed4dd-cb0a-4e54-94b7-28eb4826ef5c" status: 200 len: 1459 microversion: 2.1 time: 0.181755 Nov 22 12:33:42.703464 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 611/1297] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:33:42 2021] GET /compute/v2.1/servers/9d7ed4dd-cb0a-4e54-94b7-28eb4826ef5c => generated 1459 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:33:43.343157 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [req-fab0a9c6-8430-4dff-961f-dab03be521e5 req-2ce320ba-fb7e-4539-832a-30489299fc75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d7ed4dd-cb0a-4e54-94b7-28eb4826ef5c", "name": "network-vif-deleted", "tag": "d15fb1fe-de3e-49de-a037-e523ad429758"}]} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:33:43.345415 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 12:33:43.345415 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: warnings.warn(msg) Nov 22 12:33:43.354587 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [req-fab0a9c6-8430-4dff-961f-dab03be521e5 req-2ce320ba-fb7e-4539-832a-30489299fc75 service nova] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:33:43.355069 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [req-fab0a9c6-8430-4dff-961f-dab03be521e5 req-2ce320ba-fb7e-4539-832a-30489299fc75 service nova] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:33:43.367249 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.compute.server_external_events [req-fab0a9c6-8430-4dff-961f-dab03be521e5 req-2ce320ba-fb7e-4539-832a-30489299fc75 service nova] Creating event network-vif-deleted:d15fb1fe-de3e-49de-a037-e523ad429758 for instance 9d7ed4dd-cb0a-4e54-94b7-28eb4826ef5c on hv-cinder-76845 Nov 22 12:33:43.372334 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [req-fab0a9c6-8430-4dff-961f-dab03be521e5 req-2ce320ba-fb7e-4539-832a-30489299fc75 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032931 Nov 22 12:33:43.373361 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 687/1298] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Nov 22 12:33:43 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 12:33:43.720654 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-9d7145b1-dbb8-4131-b133-1a7b22192eb5 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:33:43.721409 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-9d7145b1-dbb8-4131-b133-1a7b22192eb5 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] [instance: 9d7ed4dd-cb0a-4e54-94b7-28eb4826ef5c] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:33:43.728788 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-9d7145b1-dbb8-4131-b133-1a7b22192eb5 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:33:43.729251 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-9d7145b1-dbb8-4131-b133-1a7b22192eb5 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:33:43.730027 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-9d7145b1-dbb8-4131-b133-1a7b22192eb5 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:33:43.730462 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-9d7145b1-dbb8-4131-b133-1a7b22192eb5 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:33:43.765177 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-9d7145b1-dbb8-4131-b133-1a7b22192eb5 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:33:43.765664 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-9d7145b1-dbb8-4131-b133-1a7b22192eb5 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:33:43.766415 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.objects.instance [None req-9d7145b1-dbb8-4131-b133-1a7b22192eb5 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lazy-loading 'fault' on Instance uuid 9d7ed4dd-cb0a-4e54-94b7-28eb4826ef5c {{(pid=116273) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 22 12:33:43.807565 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-9d7145b1-dbb8-4131-b133-1a7b22192eb5 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2c63ddb0134a3799806162af19c3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb29d996e3de41b0b21ee7ccd827eaea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:33:43.815651 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-9d7145b1-dbb8-4131-b133-1a7b22192eb5 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] 10.222.0.66 "GET /compute/v2.1/servers/9d7ed4dd-cb0a-4e54-94b7-28eb4826ef5c" status: 200 len: 1230 microversion: 2.1 time: 0.099245 Nov 22 12:33:43.816217 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 612/1299] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:33:43 2021] GET /compute/v2.1/servers/9d7ed4dd-cb0a-4e54-94b7-28eb4826ef5c => generated 1230 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:33:44.833998 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-6beaf9bb-81a9-4ecf-971d-dbee7dde1bfb tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:33:44.834717 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-6beaf9bb-81a9-4ecf-971d-dbee7dde1bfb tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] [instance: 9d7ed4dd-cb0a-4e54-94b7-28eb4826ef5c] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:33:44.841363 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-6beaf9bb-81a9-4ecf-971d-dbee7dde1bfb tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:33:44.841812 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-6beaf9bb-81a9-4ecf-971d-dbee7dde1bfb tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:33:44.842593 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-6beaf9bb-81a9-4ecf-971d-dbee7dde1bfb tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:33:44.842999 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-6beaf9bb-81a9-4ecf-971d-dbee7dde1bfb tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:33:44.856836 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.wsgi [None req-6beaf9bb-81a9-4ecf-971d-dbee7dde1bfb tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] HTTP exception thrown: Instance 9d7ed4dd-cb0a-4e54-94b7-28eb4826ef5c could not be found. Nov 22 12:33:44.857421 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-6beaf9bb-81a9-4ecf-971d-dbee7dde1bfb tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Returning 404 to user: Instance 9d7ed4dd-cb0a-4e54-94b7-28eb4826ef5c could not be found. {{(pid=116272) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 12:33:44.858244 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-6beaf9bb-81a9-4ecf-971d-dbee7dde1bfb tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] 10.222.0.66 "GET /compute/v2.1/servers/9d7ed4dd-cb0a-4e54-94b7-28eb4826ef5c" status: 404 len: 111 microversion: 2.1 time: 0.028888 Nov 22 12:33:44.858781 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 688/1300] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:33:44 2021] GET /compute/v2.1/servers/9d7ed4dd-cb0a-4e54-94b7-28eb4826ef5c => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 22 12:33:48.261486 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-64898d7b-3017-4732-be92-a6434b2baf3b tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:33:48.262039 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-64898d7b-3017-4732-be92-a6434b2baf3b tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] [instance: 059fc536-4c3e-42ae-889d-9d87177ef9dd] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:33:48.263446 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [req-e410639c-f18f-4a56-b6ba-c2bf80e8a45b req-c9a22a39-8dcb-455a-961e-4443d5e9ce75 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "059fc536-4c3e-42ae-889d-9d87177ef9dd", "tag": "33464858-d2a4-4a97-b98e-ab0137a739a1"}]} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:33:48.265481 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 12:33:48.265481 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: warnings.warn(msg) Nov 22 12:33:48.268615 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-64898d7b-3017-4732-be92-a6434b2baf3b tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:33:48.269382 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-64898d7b-3017-4732-be92-a6434b2baf3b tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:33:48.270243 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-64898d7b-3017-4732-be92-a6434b2baf3b tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:33:48.270735 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-64898d7b-3017-4732-be92-a6434b2baf3b tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:33:48.272984 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [req-e410639c-f18f-4a56-b6ba-c2bf80e8a45b req-c9a22a39-8dcb-455a-961e-4443d5e9ce75 service nova] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:33:48.273435 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [req-e410639c-f18f-4a56-b6ba-c2bf80e8a45b req-c9a22a39-8dcb-455a-961e-4443d5e9ce75 service nova] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:33:48.288576 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.compute.server_external_events [req-e410639c-f18f-4a56-b6ba-c2bf80e8a45b req-c9a22a39-8dcb-455a-961e-4443d5e9ce75 service nova] Creating event network-changed:33464858-d2a4-4a97-b98e-ab0137a739a1 for instance 059fc536-4c3e-42ae-889d-9d87177ef9dd on hv-cinder-76845 Nov 22 12:33:48.295460 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [req-e410639c-f18f-4a56-b6ba-c2bf80e8a45b req-c9a22a39-8dcb-455a-961e-4443d5e9ce75 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035494 Nov 22 12:33:48.296691 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 689/1301] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Nov 22 12:33:48 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 12:33:48.300156 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-64898d7b-3017-4732-be92-a6434b2baf3b tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] [instance: 059fc536-4c3e-42ae-889d-9d87177ef9dd] Going to try to terminate instance {{(pid=116273) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 22 12:33:48.382598 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-64898d7b-3017-4732-be92-a6434b2baf3b tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] 10.222.0.66 "DELETE /compute/v2.1/servers/059fc536-4c3e-42ae-889d-9d87177ef9dd" status: 204 len: 0 microversion: 2.1 time: 0.124510 Nov 22 12:33:48.386352 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 613/1302] 10.222.0.66 () {58 vars in 1238 bytes} [Mon Nov 22 12:33:48 2021] DELETE /compute/v2.1/servers/059fc536-4c3e-42ae-889d-9d87177ef9dd => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 22 12:33:48.394527 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-011e28c2-d275-4645-93e2-14c37373491b tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:33:48.395715 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-011e28c2-d275-4645-93e2-14c37373491b tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] [instance: 059fc536-4c3e-42ae-889d-9d87177ef9dd] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:33:48.402666 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-011e28c2-d275-4645-93e2-14c37373491b tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:33:48.403205 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-011e28c2-d275-4645-93e2-14c37373491b tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:33:48.404093 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-011e28c2-d275-4645-93e2-14c37373491b tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:33:48.404529 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-011e28c2-d275-4645-93e2-14c37373491b tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:33:48.632497 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.policy [None req-011e28c2-d275-4645-93e2-14c37373491b tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2c63ddb0134a3799806162af19c3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb29d996e3de41b0b21ee7ccd827eaea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116272) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:33:48.642600 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-011e28c2-d275-4645-93e2-14c37373491b tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] 10.222.0.66 "GET /compute/v2.1/servers/059fc536-4c3e-42ae-889d-9d87177ef9dd" status: 200 len: 1578 microversion: 2.1 time: 0.254072 Nov 22 12:33:48.652346 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 690/1303] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:33:48 2021] GET /compute/v2.1/servers/059fc536-4c3e-42ae-889d-9d87177ef9dd => generated 1578 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 22 12:33:49.660574 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-6d642468-f88e-4e0c-8b89-8cb5b2368445 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:33:49.661261 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-6d642468-f88e-4e0c-8b89-8cb5b2368445 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] [instance: 059fc536-4c3e-42ae-889d-9d87177ef9dd] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:33:49.667930 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-6d642468-f88e-4e0c-8b89-8cb5b2368445 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:33:49.668371 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-6d642468-f88e-4e0c-8b89-8cb5b2368445 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:33:49.669164 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-6d642468-f88e-4e0c-8b89-8cb5b2368445 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:33:49.669589 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-6d642468-f88e-4e0c-8b89-8cb5b2368445 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:33:49.818596 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-6d642468-f88e-4e0c-8b89-8cb5b2368445 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2c63ddb0134a3799806162af19c3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb29d996e3de41b0b21ee7ccd827eaea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:33:49.827569 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-6d642468-f88e-4e0c-8b89-8cb5b2368445 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] 10.222.0.66 "GET /compute/v2.1/servers/059fc536-4c3e-42ae-889d-9d87177ef9dd" status: 200 len: 1459 microversion: 2.1 time: 0.170668 Nov 22 12:33:49.828615 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 614/1304] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:33:49 2021] GET /compute/v2.1/servers/059fc536-4c3e-42ae-889d-9d87177ef9dd => generated 1459 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:33:50.492264 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [req-e860abb0-39bd-45b2-a837-e7ada0a81531 req-563bef54-9347-41f9-84fc-500f08ba1480 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "059fc536-4c3e-42ae-889d-9d87177ef9dd", "name": "network-vif-deleted", "tag": "33464858-d2a4-4a97-b98e-ab0137a739a1"}]} {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 22 12:33:50.493880 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 22 12:33:50.493880 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: warnings.warn(msg) Nov 22 12:33:50.502924 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [req-e860abb0-39bd-45b2-a837-e7ada0a81531 req-563bef54-9347-41f9-84fc-500f08ba1480 service nova] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:33:50.503477 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [req-e860abb0-39bd-45b2-a837-e7ada0a81531 req-563bef54-9347-41f9-84fc-500f08ba1480 service nova] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:33:50.515138 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.compute.server_external_events [req-e860abb0-39bd-45b2-a837-e7ada0a81531 req-563bef54-9347-41f9-84fc-500f08ba1480 service nova] Creating event network-vif-deleted:33464858-d2a4-4a97-b98e-ab0137a739a1 for instance 059fc536-4c3e-42ae-889d-9d87177ef9dd on hv-cinder-76845 Nov 22 12:33:50.520376 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [req-e860abb0-39bd-45b2-a837-e7ada0a81531 req-563bef54-9347-41f9-84fc-500f08ba1480 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032049 Nov 22 12:33:50.521294 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 691/1305] 10.222.0.66 () {64 vars in 1317 bytes} [Mon Nov 22 12:33:50 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 22 12:33:50.849277 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-0c7d649f-af3b-417e-997a-dd79a292cd19 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:33:50.849894 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-0c7d649f-af3b-417e-997a-dd79a292cd19 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] [instance: 059fc536-4c3e-42ae-889d-9d87177ef9dd] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:33:50.856621 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-0c7d649f-af3b-417e-997a-dd79a292cd19 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:33:50.857072 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-0c7d649f-af3b-417e-997a-dd79a292cd19 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:33:50.857877 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-0c7d649f-af3b-417e-997a-dd79a292cd19 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:33:50.858309 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-0c7d649f-af3b-417e-997a-dd79a292cd19 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:33:50.892342 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-0c7d649f-af3b-417e-997a-dd79a292cd19 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:33:50.892789 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-0c7d649f-af3b-417e-997a-dd79a292cd19 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:33:50.893236 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.objects.instance [None req-0c7d649f-af3b-417e-997a-dd79a292cd19 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lazy-loading 'fault' on Instance uuid 059fc536-4c3e-42ae-889d-9d87177ef9dd {{(pid=116273) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 22 12:33:50.937775 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.policy [None req-0c7d649f-af3b-417e-997a-dd79a292cd19 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf2c63ddb0134a3799806162af19c3b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb29d996e3de41b0b21ee7ccd827eaea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116273) authorize /opt/stack/nova/nova/policy.py:199}} Nov 22 12:33:50.949993 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-0c7d649f-af3b-417e-997a-dd79a292cd19 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] 10.222.0.66 "GET /compute/v2.1/servers/059fc536-4c3e-42ae-889d-9d87177ef9dd" status: 200 len: 1230 microversion: 2.1 time: 0.104174 Nov 22 12:33:50.950825 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 615/1306] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:33:50 2021] GET /compute/v2.1/servers/059fc536-4c3e-42ae-889d-9d87177ef9dd => generated 1230 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 22 12:33:51.973715 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-cfacad88-095e-4cd9-afa4-10daf45e8aad tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:33:51.974442 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-cfacad88-095e-4cd9-afa4-10daf45e8aad tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] [instance: 059fc536-4c3e-42ae-889d-9d87177ef9dd] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:33:51.982811 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-cfacad88-095e-4cd9-afa4-10daf45e8aad tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:33:51.983458 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-cfacad88-095e-4cd9-afa4-10daf45e8aad tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:33:51.984569 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-cfacad88-095e-4cd9-afa4-10daf45e8aad tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:33:51.985058 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-cfacad88-095e-4cd9-afa4-10daf45e8aad tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:33:52.003754 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.wsgi [None req-cfacad88-095e-4cd9-afa4-10daf45e8aad tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] HTTP exception thrown: Instance 059fc536-4c3e-42ae-889d-9d87177ef9dd could not be found. Nov 22 12:33:52.004335 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-cfacad88-095e-4cd9-afa4-10daf45e8aad tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Returning 404 to user: Instance 059fc536-4c3e-42ae-889d-9d87177ef9dd could not be found. {{(pid=116272) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 12:33:52.005183 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-cfacad88-095e-4cd9-afa4-10daf45e8aad tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] 10.222.0.66 "GET /compute/v2.1/servers/059fc536-4c3e-42ae-889d-9d87177ef9dd" status: 404 len: 111 microversion: 2.1 time: 0.036616 Nov 22 12:33:52.005713 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 692/1307] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:33:51 2021] GET /compute/v2.1/servers/059fc536-4c3e-42ae-889d-9d87177ef9dd => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 22 12:33:52.502521 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-f8007931-429f-43c1-ae33-72993a43eb98 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Calling method '>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:33:52.503093 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.compute.api [None req-f8007931-429f-43c1-ae33-72993a43eb98 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] [instance: 1b4a3c13-ae43-435b-8747-ac95a2dd9aa3] Fetching instance by UUID {{(pid=116273) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:33:52.509781 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-f8007931-429f-43c1-ae33-72993a43eb98 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:33:52.510225 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-f8007931-429f-43c1-ae33-72993a43eb98 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:33:52.511004 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-f8007931-429f-43c1-ae33-72993a43eb98 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:33:52.511601 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG oslo_concurrency.lockutils [None req-f8007931-429f-43c1-ae33-72993a43eb98 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116273) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:33:52.525029 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.wsgi [None req-f8007931-429f-43c1-ae33-72993a43eb98 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] HTTP exception thrown: Instance 1b4a3c13-ae43-435b-8747-ac95a2dd9aa3 could not be found. Nov 22 12:33:52.525684 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-f8007931-429f-43c1-ae33-72993a43eb98 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Returning 404 to user: Instance 1b4a3c13-ae43-435b-8747-ac95a2dd9aa3 could not be found. {{(pid=116273) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 12:33:52.526470 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-f8007931-429f-43c1-ae33-72993a43eb98 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] 10.222.0.66 "DELETE /compute/v2.1/servers/1b4a3c13-ae43-435b-8747-ac95a2dd9aa3" status: 404 len: 111 microversion: 2.1 time: 0.028229 Nov 22 12:33:52.527007 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 616/1308] 10.222.0.66 () {58 vars in 1238 bytes} [Mon Nov 22 12:33:52 2021] DELETE /compute/v2.1/servers/1b4a3c13-ae43-435b-8747-ac95a2dd9aa3 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 22 12:33:52.535461 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-f8ff5371-1cf3-4cea-953a-22c1997af398 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Calling method '>' {{(pid=116272) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:33:52.536074 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.compute.api [None req-f8ff5371-1cf3-4cea-953a-22c1997af398 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] [instance: 1b4a3c13-ae43-435b-8747-ac95a2dd9aa3] Fetching instance by UUID {{(pid=116272) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 22 12:33:52.542412 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-f8ff5371-1cf3-4cea-953a-22c1997af398 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:33:52.542862 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-f8ff5371-1cf3-4cea-953a-22c1997af398 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:33:52.543768 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-f8ff5371-1cf3-4cea-953a-22c1997af398 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 22 12:33:52.544205 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG oslo_concurrency.lockutils [None req-f8ff5371-1cf3-4cea-953a-22c1997af398 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Lock "68c9e085-8a03-42f8-94bd-bbf67f51e1ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116272) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 22 12:33:52.559050 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.wsgi [None req-f8ff5371-1cf3-4cea-953a-22c1997af398 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] HTTP exception thrown: Instance 1b4a3c13-ae43-435b-8747-ac95a2dd9aa3 could not be found. Nov 22 12:33:52.559696 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: DEBUG nova.api.openstack.wsgi [None req-f8ff5371-1cf3-4cea-953a-22c1997af398 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Returning 404 to user: Instance 1b4a3c13-ae43-435b-8747-ac95a2dd9aa3 could not be found. {{(pid=116272) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 22 12:33:52.560505 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO nova.api.openstack.requestlog [None req-f8ff5371-1cf3-4cea-953a-22c1997af398 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] 10.222.0.66 "GET /compute/v2.1/servers/1b4a3c13-ae43-435b-8747-ac95a2dd9aa3" status: 404 len: 111 microversion: 2.1 time: 0.029064 Nov 22 12:33:52.561072 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: [pid: 116272|app: 0|req: 693/1309] 10.222.0.66 () {58 vars in 1235 bytes} [Mon Nov 22 12:33:52 2021] GET /compute/v2.1/servers/1b4a3c13-ae43-435b-8747-ac95a2dd9aa3 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 22 12:33:53.881238 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: DEBUG nova.api.openstack.wsgi [None req-2174e076-678d-4470-aa9d-aee1d67c9918 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] Calling method '.version_select at 0x7fa1a33b0af0>' {{(pid=116273) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 22 12:33:53.905825 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO nova.api.openstack.requestlog [None req-2174e076-678d-4470-aa9d-aee1d67c9918 tempest-TestVolumeBootPattern-6858092 tempest-TestVolumeBootPattern-6858092-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-250070142" status: 202 len: 0 microversion: 2.1 time: 0.028551 Nov 22 12:33:53.906570 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: [pid: 116273|app: 0|req: 617/1310] 10.222.0.66 () {58 vars in 1259 bytes} [Mon Nov 22 12:33:53 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-250070142 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 22 12:35:24.647978 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 22 12:35:24.648645 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: Mon Nov 22 12:35:24 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 22 12:35:50.718282 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 22 12:35:50.718997 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: Mon Nov 22 12:35:50 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 22 12:36:09.360774 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 22 12:36:09.361485 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: Mon Nov 22 12:36:09 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 22 12:37:29.008052 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 22 12:37:29.008736 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: Mon Nov 22 12:37:29 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 22 12:38:44.666314 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 22 12:38:44.667086 dv-cinder-768458-13-iscsi devstack@n-api.service[116272]: Mon Nov 22 12:38:44 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 22 12:39:10.741170 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 22 12:39:10.741906 dv-cinder-768458-13-iscsi devstack@n-api.service[116273]: Mon Nov 22 12:39:10 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!